Jul 28 16:33:44.775319 ip-10-0-140-245 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 28 16:33:44.775331 ip-10-0-140-245 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 28 16:33:44.775338 ip-10-0-140-245 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 28 16:33:44.775547 ip-10-0-140-245 systemd[1]: Failed to start Kubernetes Kubelet. Jul 28 16:33:54.994898 ip-10-0-140-245 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 28 16:33:54.994915 ip-10-0-140-245 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot e6b72a1498874548b409152ef9d0eeca -- Jul 28 16:35:51.091884 ip-10-0-140-245 systemd[1]: Starting Kubernetes Kubelet... Jul 28 16:35:51.454026 ip-10-0-140-245 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 16:35:51.454026 ip-10-0-140-245 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 28 16:35:51.454026 ip-10-0-140-245 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 16:35:51.454026 ip-10-0-140-245 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 28 16:35:51.454026 ip-10-0-140-245 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 16:35:51.455811 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.455672 2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 28 16:35:51.459975 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.459958 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 16:35:51.459975 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.459975 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 16:35:51.460038 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.459981 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 16:35:51.460038 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.459985 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 16:35:51.460038 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.459988 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 16:35:51.460038 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.459992 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 16:35:51.460038 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.459995 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 16:35:51.460038 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.459998 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 16:35:51.460038 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460001 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 16:35:51.460038 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460004 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 16:35:51.460038 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460006 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 16:35:51.460038 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460009 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 16:35:51.460038 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460011 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 16:35:51.460038 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460014 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 16:35:51.460038 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460017 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 16:35:51.460038 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460020 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 16:35:51.460038 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460022 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 16:35:51.460038 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460025 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 16:35:51.460038 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460028 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 16:35:51.460038 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460030 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 16:35:51.460038 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460033 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 16:35:51.460491 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460035 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 16:35:51.460491 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460038 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 16:35:51.460491 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460041 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 16:35:51.460491 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460044 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 16:35:51.460491 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460047 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 16:35:51.460491 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460049 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 16:35:51.460491 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460052 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 16:35:51.460491 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460055 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 16:35:51.460491 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460058 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 16:35:51.460491 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460061 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 16:35:51.460491 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460063 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 16:35:51.460491 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460065 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 16:35:51.460491 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460068 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 16:35:51.460491 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460070 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 16:35:51.460491 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460073 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 16:35:51.460491 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460076 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 16:35:51.460491 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460078 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 16:35:51.460491 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460081 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 16:35:51.460491 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460083 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 16:35:51.460491 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460086 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 16:35:51.461000 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460088 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 16:35:51.461000 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460090 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 16:35:51.461000 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460093 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 16:35:51.461000 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460096 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 16:35:51.461000 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460098 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 16:35:51.461000 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460101 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 16:35:51.461000 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460103 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 16:35:51.461000 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460105 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 16:35:51.461000 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460108 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 16:35:51.461000 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460111 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 16:35:51.461000 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460113 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 16:35:51.461000 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460115 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 16:35:51.461000 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460118 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 16:35:51.461000 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460122 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 16:35:51.461000 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460125 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 16:35:51.461000 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460127 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 16:35:51.461000 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460130 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 16:35:51.461000 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460132 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 16:35:51.461000 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460136 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 16:35:51.461000 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460139 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 16:35:51.461495 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460141 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 16:35:51.461495 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460145 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 16:35:51.461495 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460148 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 16:35:51.461495 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460151 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 16:35:51.461495 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460153 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 16:35:51.461495 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460156 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 16:35:51.461495 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460158 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 16:35:51.461495 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460161 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 16:35:51.461495 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460164 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 16:35:51.461495 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460167 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 16:35:51.461495 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460170 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 16:35:51.461495 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460172 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 16:35:51.461495 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460175 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 16:35:51.461495 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460177 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 28 16:35:51.461495 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460180 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 16:35:51.461495 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460183 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 16:35:51.461495 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460185 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 16:35:51.461495 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460188 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 16:35:51.461495 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460190 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 16:35:51.462014 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460193 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 16:35:51.462014 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460196 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 16:35:51.462014 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460198 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 16:35:51.462014 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460201 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 16:35:51.462014 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460203 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 16:35:51.462014 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460206 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 16:35:51.462014 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460209 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 16:35:51.462014 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460211 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 16:35:51.462014 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460214 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 16:35:51.462014 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460217 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 16:35:51.462014 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460219 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 16:35:51.462014 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460222 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 16:35:51.462014 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460226 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 16:35:51.462014 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460231 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 16:35:51.462014 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460235 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 16:35:51.462014 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460237 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 16:35:51.462014 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460240 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 16:35:51.462014 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460243 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 16:35:51.462014 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.460246 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 16:35:51.462494 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461020 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 16:35:51.462494 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461027 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 16:35:51.462494 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461031 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 16:35:51.462494 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461039 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 16:35:51.462494 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461042 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 16:35:51.462494 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461045 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 16:35:51.462494 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461048 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 16:35:51.462494 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461051 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 16:35:51.462494 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461054 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 16:35:51.462494 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461056 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 16:35:51.462494 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461059 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 16:35:51.462494 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461063 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 16:35:51.462494 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461065 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 16:35:51.462494 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461068 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 16:35:51.462494 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461071 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 16:35:51.462494 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461073 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 16:35:51.462494 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461076 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 16:35:51.462494 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461078 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 16:35:51.462494 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461081 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 16:35:51.462494 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461084 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 16:35:51.463006 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461087 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 16:35:51.463006 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461090 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 16:35:51.463006 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461092 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 16:35:51.463006 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461095 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 16:35:51.463006 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461097 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 16:35:51.463006 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461101 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 16:35:51.463006 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461105 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 16:35:51.463006 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461108 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 16:35:51.463006 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461111 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 16:35:51.463006 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461113 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 16:35:51.463006 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461118 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 16:35:51.463006 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461121 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 16:35:51.463006 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461124 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 16:35:51.463006 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461127 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 16:35:51.463006 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461129 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 16:35:51.463006 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461132 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 16:35:51.463006 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461140 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 16:35:51.463006 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461143 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 16:35:51.463006 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461146 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 16:35:51.463478 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461148 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 16:35:51.463478 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461151 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 16:35:51.463478 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461154 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 16:35:51.463478 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461156 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 28 16:35:51.463478 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461160 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 16:35:51.463478 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461162 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 16:35:51.463478 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461165 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 16:35:51.463478 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461168 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 16:35:51.463478 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461171 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 16:35:51.463478 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461173 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 16:35:51.463478 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461176 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 16:35:51.463478 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461178 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 16:35:51.463478 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461181 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 16:35:51.463478 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461184 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 16:35:51.463478 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461186 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 16:35:51.463478 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461189 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 16:35:51.463478 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461191 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 16:35:51.463478 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461194 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 16:35:51.463478 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461196 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 16:35:51.463478 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461199 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 16:35:51.464000 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461201 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 16:35:51.464000 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461204 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 16:35:51.464000 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461206 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 16:35:51.464000 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461208 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 16:35:51.464000 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461211 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 16:35:51.464000 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461213 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 16:35:51.464000 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461216 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 16:35:51.464000 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461218 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 16:35:51.464000 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461220 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 16:35:51.464000 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461223 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 16:35:51.464000 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461230 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 16:35:51.464000 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461233 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 16:35:51.464000 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461236 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 16:35:51.464000 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461238 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 16:35:51.464000 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461241 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 16:35:51.464000 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461243 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 16:35:51.464000 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461246 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 16:35:51.464000 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461249 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 16:35:51.464000 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461251 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 16:35:51.464000 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461254 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 16:35:51.464498 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461258 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 16:35:51.464498 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461261 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 16:35:51.464498 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461264 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 16:35:51.464498 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461266 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 16:35:51.464498 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461269 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 16:35:51.464498 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461271 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 16:35:51.464498 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461274 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 16:35:51.464498 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461277 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 16:35:51.464498 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461279 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 16:35:51.464498 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461282 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 16:35:51.464498 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461285 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 16:35:51.464498 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461287 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 16:35:51.464498 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461289 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 16:35:51.464498 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461292 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 16:35:51.464498 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461294 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 16:35:51.464498 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461297 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 16:35:51.464498 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461299 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 16:35:51.464498 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461302 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 16:35:51.464498 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461305 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 16:35:51.464988 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461307 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 16:35:51.464988 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461710 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 16:35:51.464988 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461715 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 16:35:51.464988 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461719 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 16:35:51.464988 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461729 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 16:35:51.464988 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461732 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 16:35:51.464988 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461735 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 16:35:51.464988 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461738 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 16:35:51.464988 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461740 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 16:35:51.464988 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461745 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 16:35:51.464988 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461749 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 16:35:51.464988 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461752 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 16:35:51.464988 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461755 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 16:35:51.464988 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461759 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 16:35:51.464988 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461762 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 16:35:51.464988 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461764 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 16:35:51.464988 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461767 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 16:35:51.464988 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461770 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 16:35:51.464988 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461773 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 16:35:51.465499 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461776 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 16:35:51.465499 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461779 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 16:35:51.465499 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461781 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 16:35:51.465499 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461784 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 16:35:51.465499 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461786 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 16:35:51.465499 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461789 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 16:35:51.465499 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461792 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 16:35:51.465499 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461794 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 16:35:51.465499 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461797 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 16:35:51.465499 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461799 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 16:35:51.465499 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461802 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 16:35:51.465499 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461804 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 16:35:51.465499 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461807 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 16:35:51.465499 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461809 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 16:35:51.465499 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461812 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 16:35:51.465499 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461814 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 28 16:35:51.465499 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461817 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 16:35:51.465499 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461820 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 16:35:51.465499 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461823 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 16:35:51.465499 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461825 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 16:35:51.466007 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461828 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 16:35:51.466007 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461830 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 16:35:51.466007 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461833 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 16:35:51.466007 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461836 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 16:35:51.466007 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461839 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 16:35:51.466007 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461843 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 16:35:51.466007 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461845 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 16:35:51.466007 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461848 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 16:35:51.466007 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461851 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 16:35:51.466007 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461854 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 16:35:51.466007 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461857 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 16:35:51.466007 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461859 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 16:35:51.466007 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461862 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 16:35:51.466007 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461865 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 16:35:51.466007 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461867 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 16:35:51.466007 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461870 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 16:35:51.466007 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461872 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 16:35:51.466007 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461875 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 16:35:51.466007 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461877 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 16:35:51.466474 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461880 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 16:35:51.466474 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461882 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 16:35:51.466474 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461884 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 16:35:51.466474 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461887 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 16:35:51.466474 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461889 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 16:35:51.466474 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461892 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 16:35:51.466474 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461894 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 16:35:51.466474 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461897 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 16:35:51.466474 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461899 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 16:35:51.466474 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461902 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 16:35:51.466474 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461904 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 16:35:51.466474 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461907 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 16:35:51.466474 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461910 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 16:35:51.466474 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461912 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 16:35:51.466474 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461917 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 16:35:51.466474 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461920 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 16:35:51.466474 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461922 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 16:35:51.466474 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461925 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 16:35:51.466474 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461928 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 16:35:51.466474 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461930 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 16:35:51.467172 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461933 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 16:35:51.467172 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461935 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 16:35:51.467172 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461938 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 16:35:51.467172 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461940 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 16:35:51.467172 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461944 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 16:35:51.467172 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461948 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 16:35:51.467172 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461952 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 16:35:51.467172 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461955 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 16:35:51.467172 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461958 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 16:35:51.467172 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461961 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 16:35:51.467172 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461964 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 16:35:51.467172 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461966 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 16:35:51.467172 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461969 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 16:35:51.467172 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461972 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 16:35:51.467172 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461974 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 16:35:51.467172 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461977 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 16:35:51.467172 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461979 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 16:35:51.467172 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461982 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 16:35:51.467172 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461984 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 16:35:51.467890 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461987 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 16:35:51.467890 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461989 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 16:35:51.467890 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.461992 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 16:35:51.467890 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462063 2563 flags.go:64] FLAG: --address="0.0.0.0" Jul 28 16:35:51.467890 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462070 2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 28 16:35:51.467890 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462076 2563 flags.go:64] FLAG: --anonymous-auth="true" Jul 28 16:35:51.467890 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462081 2563 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 28 16:35:51.467890 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462086 2563 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 28 16:35:51.467890 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462090 2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 28 16:35:51.467890 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462094 2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 28 16:35:51.467890 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462099 2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 28 16:35:51.467890 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462102 2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 28 16:35:51.467890 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462106 2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 28 16:35:51.467890 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462110 2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 28 16:35:51.467890 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462114 2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 28 16:35:51.467890 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462117 2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 28 16:35:51.467890 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462120 2563 flags.go:64] FLAG: --cgroup-root="" Jul 28 16:35:51.467890 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462123 2563 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 28 16:35:51.467890 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462126 2563 flags.go:64] FLAG: --client-ca-file="" Jul 28 16:35:51.467890 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462128 2563 flags.go:64] FLAG: --cloud-provider="external" Jul 28 16:35:51.467890 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462131 2563 flags.go:64] FLAG: --cluster-dns="[]" Jul 28 16:35:51.467890 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462134 2563 flags.go:64] FLAG: --cluster-domain="" Jul 28 16:35:51.467890 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462137 2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 28 16:35:51.467890 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462141 2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 28 16:35:51.468448 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462144 2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 28 16:35:51.468448 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462147 2563 flags.go:64] FLAG: --container-log-max-files="5" Jul 28 16:35:51.468448 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462151 2563 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 28 16:35:51.468448 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462154 2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 28 16:35:51.468448 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462157 2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 28 16:35:51.468448 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462160 2563 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 28 16:35:51.468448 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462163 2563 flags.go:64] FLAG: --contention-profiling="false" Jul 28 16:35:51.468448 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462166 2563 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 28 16:35:51.468448 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462169 2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 28 16:35:51.468448 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462172 2563 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 28 16:35:51.468448 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462175 2563 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 28 16:35:51.468448 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462179 2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 28 16:35:51.468448 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462182 2563 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 28 16:35:51.468448 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462185 2563 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 28 16:35:51.468448 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462189 2563 flags.go:64] FLAG: --enable-load-reader="false" Jul 28 16:35:51.468448 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462193 2563 flags.go:64] FLAG: --enable-server="true" Jul 28 16:35:51.468448 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462196 2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 28 16:35:51.468448 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462200 2563 flags.go:64] FLAG: --event-burst="100" Jul 28 16:35:51.468448 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462204 2563 flags.go:64] FLAG: --event-qps="50" Jul 28 16:35:51.468448 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462206 2563 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 28 16:35:51.468448 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462211 2563 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 28 16:35:51.468448 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462214 2563 flags.go:64] FLAG: --eviction-hard="" Jul 28 16:35:51.468448 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462217 2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 28 16:35:51.468448 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462220 2563 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 28 16:35:51.469097 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462223 2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 28 16:35:51.469097 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462226 2563 flags.go:64] FLAG: --eviction-soft="" Jul 28 16:35:51.469097 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462229 2563 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 28 16:35:51.469097 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462232 2563 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 28 16:35:51.469097 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462235 2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 28 16:35:51.469097 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462237 2563 flags.go:64] FLAG: --experimental-mounter-path="" Jul 28 16:35:51.469097 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462240 2563 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 28 16:35:51.469097 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462243 2563 flags.go:64] FLAG: --fail-swap-on="true" Jul 28 16:35:51.469097 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462246 2563 flags.go:64] FLAG: --feature-gates="" Jul 28 16:35:51.469097 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462250 2563 flags.go:64] FLAG: --file-check-frequency="20s" Jul 28 16:35:51.469097 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462253 2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 28 16:35:51.469097 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462256 2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 28 16:35:51.469097 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462259 2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 28 16:35:51.469097 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462262 2563 flags.go:64] FLAG: --healthz-port="10248" Jul 28 16:35:51.469097 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462265 2563 flags.go:64] FLAG: --help="false" Jul 28 16:35:51.469097 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462268 2563 flags.go:64] FLAG: --hostname-override="ip-10-0-140-245.ec2.internal" Jul 28 16:35:51.469097 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462271 2563 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 28 16:35:51.469097 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462274 2563 flags.go:64] FLAG: --http-check-frequency="20s" Jul 28 16:35:51.469097 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462277 2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 28 16:35:51.469097 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462280 2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 28 16:35:51.469097 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462283 2563 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 28 16:35:51.469097 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462286 2563 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 28 16:35:51.469097 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462289 2563 flags.go:64] FLAG: --image-service-endpoint="" Jul 28 16:35:51.470069 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462296 2563 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 28 16:35:51.470069 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462299 2563 flags.go:64] FLAG: --kube-api-burst="100" Jul 28 16:35:51.470069 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462302 2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 28 16:35:51.470069 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462305 2563 flags.go:64] FLAG: --kube-api-qps="50" Jul 28 16:35:51.470069 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462308 2563 flags.go:64] FLAG: --kube-reserved="" Jul 28 16:35:51.470069 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462312 2563 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 28 16:35:51.470069 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462314 2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 28 16:35:51.470069 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462317 2563 flags.go:64] FLAG: --kubelet-cgroups="" Jul 28 16:35:51.470069 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462320 2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 28 16:35:51.470069 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462323 2563 flags.go:64] FLAG: --lock-file="" Jul 28 16:35:51.470069 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462326 2563 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 28 16:35:51.470069 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462329 2563 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 28 16:35:51.470069 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462331 2563 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 28 16:35:51.470069 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462337 2563 flags.go:64] FLAG: --log-json-split-stream="false" Jul 28 16:35:51.470069 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462340 2563 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 28 16:35:51.470069 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462342 2563 flags.go:64] FLAG: --log-text-split-stream="false" Jul 28 16:35:51.470069 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462345 2563 flags.go:64] FLAG: --logging-format="text" Jul 28 16:35:51.470069 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462348 2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 28 16:35:51.470069 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462351 2563 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 28 16:35:51.470069 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462354 2563 flags.go:64] FLAG: --manifest-url="" Jul 28 16:35:51.470069 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462357 2563 flags.go:64] FLAG: --manifest-url-header="" Jul 28 16:35:51.470069 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462361 2563 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 28 16:35:51.470069 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462364 2563 flags.go:64] FLAG: --max-open-files="1000000" Jul 28 16:35:51.470069 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462368 2563 flags.go:64] FLAG: --max-pods="110" Jul 28 16:35:51.470069 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462370 2563 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 28 16:35:51.471074 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462373 2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 28 16:35:51.471074 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462376 2563 flags.go:64] FLAG: --memory-manager-policy="None" Jul 28 16:35:51.471074 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462379 2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 28 16:35:51.471074 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462382 2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 28 16:35:51.471074 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462385 2563 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 28 16:35:51.471074 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462388 2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 28 16:35:51.471074 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462395 2563 flags.go:64] FLAG: --node-status-max-images="50" Jul 28 16:35:51.471074 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462399 2563 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 28 16:35:51.471074 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462403 2563 flags.go:64] FLAG: --oom-score-adj="-999" Jul 28 16:35:51.471074 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462406 2563 flags.go:64] FLAG: --pod-cidr="" Jul 28 16:35:51.471074 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462409 2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 28 16:35:51.471074 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462415 2563 flags.go:64] FLAG: --pod-manifest-path="" Jul 28 16:35:51.471074 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462419 2563 flags.go:64] FLAG: --pod-max-pids="-1" Jul 28 16:35:51.471074 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462424 2563 flags.go:64] FLAG: --pods-per-core="0" Jul 28 16:35:51.471074 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462427 2563 flags.go:64] FLAG: --port="10250" Jul 28 16:35:51.471074 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462430 2563 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 28 16:35:51.471074 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462433 2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f3e3483999916820" Jul 28 16:35:51.471074 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462436 2563 flags.go:64] FLAG: --qos-reserved="" Jul 28 16:35:51.471074 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462439 2563 flags.go:64] FLAG: --read-only-port="10255" Jul 28 16:35:51.471074 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462442 2563 flags.go:64] FLAG: --register-node="true" Jul 28 16:35:51.471074 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462445 2563 flags.go:64] FLAG: --register-with-taints="" Jul 28 16:35:51.471074 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462449 2563 flags.go:64] FLAG: --registry-burst="10" Jul 28 16:35:51.471074 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462452 2563 flags.go:64] FLAG: --registry-qps="5" Jul 28 16:35:51.471074 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462455 2563 flags.go:64] FLAG: --reserved-cpus="" Jul 28 16:35:51.471808 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462457 2563 flags.go:64] FLAG: --reserved-memory="" Jul 28 16:35:51.471808 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462461 2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 28 16:35:51.471808 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462464 2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 28 16:35:51.471808 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462467 2563 flags.go:64] FLAG: --rotate-certificates="false" Jul 28 16:35:51.471808 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462470 2563 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 28 16:35:51.471808 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462473 2563 flags.go:64] FLAG: --runonce="false" Jul 28 16:35:51.471808 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462475 2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 28 16:35:51.471808 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462478 2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 28 16:35:51.471808 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462482 2563 flags.go:64] FLAG: --seccomp-default="false" Jul 28 16:35:51.471808 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462484 2563 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 28 16:35:51.471808 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462487 2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 28 16:35:51.471808 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462490 2563 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 28 16:35:51.471808 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462493 2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 28 16:35:51.471808 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462496 2563 flags.go:64] FLAG: --storage-driver-password="root" Jul 28 16:35:51.471808 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462499 2563 flags.go:64] FLAG: --storage-driver-secure="false" Jul 28 16:35:51.471808 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462503 2563 flags.go:64] FLAG: --storage-driver-table="stats" Jul 28 16:35:51.471808 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462507 2563 flags.go:64] FLAG: --storage-driver-user="root" Jul 28 16:35:51.471808 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462510 2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 28 16:35:51.471808 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462513 2563 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 28 16:35:51.471808 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462516 2563 flags.go:64] FLAG: --system-cgroups="" Jul 28 16:35:51.471808 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462519 2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 28 16:35:51.471808 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462526 2563 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 28 16:35:51.471808 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462528 2563 flags.go:64] FLAG: --tls-cert-file="" Jul 28 16:35:51.471808 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462531 2563 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 28 16:35:51.471808 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462535 2563 flags.go:64] FLAG: --tls-min-version="" Jul 28 16:35:51.472394 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462537 2563 flags.go:64] FLAG: --tls-private-key-file="" Jul 28 16:35:51.472394 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462540 2563 flags.go:64] FLAG: --topology-manager-policy="none" Jul 28 16:35:51.472394 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462543 2563 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 28 16:35:51.472394 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462546 2563 flags.go:64] FLAG: --topology-manager-scope="container" Jul 28 16:35:51.472394 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462549 2563 flags.go:64] FLAG: --v="2" Jul 28 16:35:51.472394 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462553 2563 flags.go:64] FLAG: --version="false" Jul 28 16:35:51.472394 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462557 2563 flags.go:64] FLAG: --vmodule="" Jul 28 16:35:51.472394 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462561 2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 28 16:35:51.472394 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.462564 2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 28 16:35:51.472394 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462691 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 16:35:51.472394 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462695 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 16:35:51.472394 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462699 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 16:35:51.472394 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462702 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 16:35:51.472394 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462704 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 16:35:51.472394 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462707 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 16:35:51.472394 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462711 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 16:35:51.472394 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462714 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 16:35:51.472394 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462717 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 16:35:51.472394 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462719 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 16:35:51.472394 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462722 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 16:35:51.472394 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462724 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 16:35:51.472394 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462726 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 16:35:51.472994 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462730 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 16:35:51.472994 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462733 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 16:35:51.472994 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462735 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 16:35:51.472994 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462739 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 16:35:51.472994 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462741 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 16:35:51.472994 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462744 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 28 16:35:51.472994 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462747 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 16:35:51.472994 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462750 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 16:35:51.472994 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462752 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 16:35:51.472994 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462755 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 16:35:51.472994 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462758 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 16:35:51.472994 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462760 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 16:35:51.472994 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462763 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 16:35:51.472994 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462765 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 16:35:51.472994 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462768 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 16:35:51.472994 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462771 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 16:35:51.472994 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462773 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 16:35:51.472994 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462776 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 16:35:51.472994 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462779 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 16:35:51.472994 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462781 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 16:35:51.473462 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462784 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 16:35:51.473462 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462787 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 16:35:51.473462 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462789 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 16:35:51.473462 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462792 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 16:35:51.473462 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462794 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 16:35:51.473462 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462797 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 16:35:51.473462 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462799 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 16:35:51.473462 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462802 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 16:35:51.473462 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462804 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 16:35:51.473462 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462807 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 16:35:51.473462 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462809 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 16:35:51.473462 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462812 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 16:35:51.473462 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462815 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 16:35:51.473462 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462818 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 16:35:51.473462 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462820 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 16:35:51.473462 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462823 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 16:35:51.473462 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462826 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 16:35:51.473462 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462829 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 16:35:51.473462 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462833 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 16:35:51.473462 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462836 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 16:35:51.473957 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462839 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 16:35:51.473957 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462841 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 16:35:51.473957 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462844 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 16:35:51.473957 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462846 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 16:35:51.473957 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462849 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 16:35:51.473957 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462852 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 16:35:51.473957 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462856 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 16:35:51.473957 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462858 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 16:35:51.473957 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462861 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 16:35:51.473957 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462864 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 16:35:51.473957 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462866 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 16:35:51.473957 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462869 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 16:35:51.473957 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462871 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 16:35:51.473957 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462875 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 16:35:51.473957 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462879 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 16:35:51.473957 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462882 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 16:35:51.473957 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462885 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 16:35:51.473957 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462888 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 16:35:51.473957 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462890 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 16:35:51.474400 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462893 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 16:35:51.474400 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462895 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 16:35:51.474400 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462898 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 16:35:51.474400 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462900 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 16:35:51.474400 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462903 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 16:35:51.474400 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462907 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 16:35:51.474400 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462910 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 16:35:51.474400 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462913 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 16:35:51.474400 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462916 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 16:35:51.474400 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462919 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 16:35:51.474400 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462923 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 16:35:51.474400 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462927 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 16:35:51.474400 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462930 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 16:35:51.474400 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462932 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 16:35:51.474400 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462935 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 16:35:51.474400 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462938 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 16:35:51.474400 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462940 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 16:35:51.474400 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462943 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 16:35:51.474400 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462946 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 16:35:51.474856 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462949 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 16:35:51.474856 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462951 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 16:35:51.474856 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462954 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 16:35:51.474856 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462956 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 16:35:51.474856 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462959 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 16:35:51.474856 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462962 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 16:35:51.474856 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462964 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 16:35:51.474856 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.462967 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 16:35:51.474856 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.463726 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 16:35:51.474856 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.472562 2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 28 16:35:51.474856 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.472579 2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 28 16:35:51.474856 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.473536 2563 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 28 16:35:51.474856 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.473547 2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 28 16:35:51.474856 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473627 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 16:35:51.475186 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473633 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 16:35:51.475186 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473637 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 16:35:51.475186 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473640 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 16:35:51.475186 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473644 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 16:35:51.475186 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473647 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 16:35:51.475186 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473650 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 16:35:51.475186 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473653 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 16:35:51.475186 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473655 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 16:35:51.475186 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473658 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 16:35:51.475186 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473660 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 16:35:51.475186 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473663 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 16:35:51.475186 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473665 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 16:35:51.475186 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473668 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 16:35:51.475186 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473670 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 16:35:51.475186 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473673 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 16:35:51.475186 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473675 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 16:35:51.475186 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473678 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 16:35:51.475186 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473681 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 16:35:51.475186 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473684 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 16:35:51.475186 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473686 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 16:35:51.475710 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473689 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 16:35:51.475710 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473692 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 16:35:51.475710 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473695 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 16:35:51.475710 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473698 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 16:35:51.475710 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473700 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 16:35:51.475710 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473703 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 16:35:51.475710 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473705 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 16:35:51.475710 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473708 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 16:35:51.475710 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473710 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 16:35:51.475710 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473713 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 16:35:51.475710 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473715 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 16:35:51.475710 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473718 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 16:35:51.475710 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473721 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 16:35:51.475710 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473723 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 16:35:51.475710 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473726 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 16:35:51.475710 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473728 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 16:35:51.475710 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473731 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 16:35:51.475710 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473733 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 16:35:51.475710 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473735 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 16:35:51.475710 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473738 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 16:35:51.476175 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473740 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 16:35:51.476175 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473743 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 16:35:51.476175 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473745 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 16:35:51.476175 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473748 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 16:35:51.476175 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473750 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 16:35:51.476175 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473752 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 16:35:51.476175 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473755 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 16:35:51.476175 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473760 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 16:35:51.476175 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473763 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 16:35:51.476175 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473766 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 16:35:51.476175 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473769 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 16:35:51.476175 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473772 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 16:35:51.476175 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473776 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 16:35:51.476175 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473778 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 16:35:51.476175 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473781 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 16:35:51.476175 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473784 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 16:35:51.476175 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473787 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 16:35:51.476175 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473789 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 16:35:51.476175 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473792 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 16:35:51.476678 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473794 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 16:35:51.476678 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473797 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 16:35:51.476678 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473799 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 16:35:51.476678 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473802 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 16:35:51.476678 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473805 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 16:35:51.476678 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473807 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 16:35:51.476678 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473809 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 16:35:51.476678 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473812 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 16:35:51.476678 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473814 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 16:35:51.476678 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473817 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 16:35:51.476678 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473819 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 16:35:51.476678 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473822 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 16:35:51.476678 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473824 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 16:35:51.476678 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473827 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 16:35:51.476678 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473829 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 16:35:51.476678 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473832 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 16:35:51.476678 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473834 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 16:35:51.476678 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473836 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 16:35:51.476678 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473839 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 28 16:35:51.476678 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473843 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 16:35:51.477185 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473845 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 16:35:51.477185 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473848 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 16:35:51.477185 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473851 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 16:35:51.477185 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473853 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 16:35:51.477185 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473856 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 16:35:51.477185 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473860 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 16:35:51.477185 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473863 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 16:35:51.477185 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473866 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 16:35:51.477185 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473869 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 16:35:51.477185 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473871 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 16:35:51.477185 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473873 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 16:35:51.477185 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473876 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 16:35:51.477185 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473878 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 16:35:51.477185 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473881 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 16:35:51.477185 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473883 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 16:35:51.477185 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473886 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 16:35:51.477185 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473888 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 16:35:51.477185 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473891 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 16:35:51.477185 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.473893 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 16:35:51.477648 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.473898 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 16:35:51.477648 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474012 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 16:35:51.477648 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474017 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 16:35:51.477648 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474020 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 16:35:51.477648 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474022 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 16:35:51.477648 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474025 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 16:35:51.477648 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474027 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 16:35:51.477648 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474030 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 16:35:51.477648 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474032 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 16:35:51.477648 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474034 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 16:35:51.477648 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474037 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 16:35:51.477648 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474039 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 16:35:51.477648 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474041 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 16:35:51.477648 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474045 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 16:35:51.477648 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474047 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 16:35:51.477995 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474050 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 16:35:51.477995 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474053 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 16:35:51.477995 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474055 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 16:35:51.477995 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474058 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 16:35:51.477995 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474061 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 16:35:51.477995 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474063 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 16:35:51.477995 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474066 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 16:35:51.477995 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474069 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 16:35:51.477995 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474071 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 16:35:51.477995 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474073 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 16:35:51.477995 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474076 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 16:35:51.477995 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474078 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 16:35:51.477995 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474080 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 16:35:51.477995 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474083 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 16:35:51.477995 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474085 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 16:35:51.477995 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474088 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 16:35:51.477995 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474090 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 16:35:51.477995 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474092 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 16:35:51.477995 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474095 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 16:35:51.477995 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474097 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 16:35:51.478444 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474101 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 16:35:51.478444 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474104 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 16:35:51.478444 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474107 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 16:35:51.478444 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474109 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 16:35:51.478444 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474112 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 16:35:51.478444 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474114 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 16:35:51.478444 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474117 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 16:35:51.478444 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474119 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 16:35:51.478444 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474121 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 16:35:51.478444 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474123 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 16:35:51.478444 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474126 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 16:35:51.478444 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474129 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 28 16:35:51.478444 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474132 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 16:35:51.478444 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474135 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 16:35:51.478444 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474137 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 16:35:51.478444 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474139 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 16:35:51.478444 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474142 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 16:35:51.478444 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474145 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 16:35:51.478444 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474147 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 16:35:51.478890 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474149 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 16:35:51.478890 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474152 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 16:35:51.478890 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474154 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 16:35:51.478890 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474157 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 16:35:51.478890 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474159 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 16:35:51.478890 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474161 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 16:35:51.478890 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474164 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 16:35:51.478890 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474166 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 16:35:51.478890 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474168 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 16:35:51.478890 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474171 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 16:35:51.478890 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474173 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 16:35:51.478890 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474175 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 16:35:51.478890 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474178 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 16:35:51.478890 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474181 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 16:35:51.478890 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474184 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 16:35:51.478890 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474187 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 16:35:51.478890 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474190 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 16:35:51.478890 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474192 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 16:35:51.478890 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474195 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 16:35:51.478890 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474198 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 16:35:51.479338 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474200 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 16:35:51.479338 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474203 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 16:35:51.479338 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474205 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 16:35:51.479338 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474208 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 16:35:51.479338 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474211 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 16:35:51.479338 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474215 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 16:35:51.479338 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474219 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 16:35:51.479338 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474222 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 16:35:51.479338 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474225 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 16:35:51.479338 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474228 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 16:35:51.479338 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474230 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 16:35:51.479338 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474233 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 16:35:51.479338 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474235 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 16:35:51.479338 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474238 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 16:35:51.479338 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474240 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 16:35:51.479338 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474243 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 16:35:51.479338 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474245 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 16:35:51.479338 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474247 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 16:35:51.479338 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474249 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 16:35:51.479885 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474252 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 16:35:51.479885 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474254 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 16:35:51.479885 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474257 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 16:35:51.479885 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474259 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 16:35:51.479885 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474262 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 16:35:51.479885 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474264 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 16:35:51.479885 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:51.474267 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 16:35:51.479885 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.474271 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 16:35:51.479885 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.474394 2563 server.go:962] "Client rotation is on, will bootstrap in background" Jul 28 16:35:51.479885 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.478191 2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 28 16:35:51.479885 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.479783 2563 server.go:1019] "Starting client certificate rotation" Jul 28 16:35:51.480174 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.479883 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 16:35:51.480174 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.479918 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 16:35:51.481929 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.481916 2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 16:35:51.483047 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.483031 2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 16:35:51.498939 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.498923 2563 log.go:25] "Validated CRI v1 runtime API" Jul 28 16:35:51.501047 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.501029 2563 log.go:25] "Validated CRI v1 image API" Jul 28 16:35:51.501876 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.501862 2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 28 16:35:51.506125 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.506105 2563 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a4da1fd5-7516-4cfb-b215-b684fcf58279:/dev/nvme0n1p4 e8f86a84-7045-49a4-a59e-29df4af3bdf2:/dev/nvme0n1p3] Jul 28 16:35:51.506195 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.506124 2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 28 16:35:51.511068 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.510958 2563 manager.go:216] Machine: {Timestamp:2026-07-28 16:35:51.509755654 +0000 UTC m=+0.303551918 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101180 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2267f0c8ae40ffe18d6f98ef3abc29 SystemUUID:ec2267f0-c8ae-40ff-e18d-6f98ef3abc29 BootID:e6b72a14-9887-4548-b409-152ef9d0eeca Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:da:2f:76:cf:c9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:da:2f:76:cf:c9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4a:83:ad:22:ff:c4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 28 16:35:51.511068 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.511058 2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 28 16:35:51.511200 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.511135 2563 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 28 16:35:51.513935 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.513911 2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 28 16:35:51.514140 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.513940 2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-245.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 28 16:35:51.514694 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.514681 2563 topology_manager.go:138] "Creating topology manager with none policy" Jul 28 16:35:51.514728 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.514698 2563 container_manager_linux.go:309] "Creating device plugin manager" Jul 28 16:35:51.514728 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.514705 2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 16:35:51.515415 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.515405 2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 16:35:51.516203 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.516194 2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 28 16:35:51.516757 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.516728 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 16:35:51.518432 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.518416 2563 state_mem.go:36] "Initialized new in-memory state store" Jul 28 16:35:51.518556 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.518547 2563 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 28 16:35:51.518596 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.518576 2563 kubelet.go:486] "Attempting to sync node with API server" Jul 28 16:35:51.518596 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.518587 2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 28 16:35:51.518657 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.518632 2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 28 16:35:51.518657 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.518643 2563 kubelet.go:398] "Adding apiserver pod source" Jul 28 16:35:51.518657 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.518652 2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 28 16:35:51.519039 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.519027 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 16:35:51.519088 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.519046 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 16:35:51.521017 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.521003 2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 28 16:35:51.522899 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.522883 2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 28 16:35:51.522985 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.522918 2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 28 16:35:51.524794 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.524780 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 28 16:35:51.524886 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.524803 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 28 16:35:51.524886 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.524813 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 28 16:35:51.524886 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.524820 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 28 16:35:51.524886 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.524833 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 28 16:35:51.524886 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.524841 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 28 16:35:51.524886 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.524852 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 28 16:35:51.524886 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.524862 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 28 16:35:51.524886 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.524874 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 28 16:35:51.524886 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.524882 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 28 16:35:51.525151 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.524895 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 28 16:35:51.525151 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.524905 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 28 16:35:51.525517 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.525506 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 28 16:35:51.525572 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.525518 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 28 16:35:51.527063 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:51.527040 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-245.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 28 16:35:51.527160 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:51.527084 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 28 16:35:51.527440 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.527422 2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-245.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 28 16:35:51.528481 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.528466 2563 server.go:1268] "Started kubelet" Jul 28 16:35:51.528570 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.528532 2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 28 16:35:51.528715 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.528649 2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 28 16:35:51.528757 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.528734 2563 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 28 16:35:51.529357 ip-10-0-140-245 systemd[1]: Started Kubernetes Kubelet. Jul 28 16:35:51.530588 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.530574 2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 28 16:35:51.531758 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.531745 2563 server.go:310] "Adding debug handlers to kubelet server" Jul 28 16:35:51.532870 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:51.532850 2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 28 16:35:51.534652 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.534639 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r8w4v" Jul 28 16:35:51.536986 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.536968 2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 28 16:35:51.536986 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.536977 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 28 16:35:51.537134 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:51.537052 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-245.ec2.internal\" not found" Jul 28 16:35:51.537555 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.537535 2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 28 16:35:51.537555 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.537546 2563 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 28 16:35:51.537721 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.537571 2563 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 28 16:35:51.537721 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.537711 2563 reconstruct.go:97] "Volume reconstruction finished" Jul 28 16:35:51.537721 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.537719 2563 reconciler.go:29] "Reconciler: start to sync state" Jul 28 16:35:51.537854 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.537752 2563 factory.go:55] Registering systemd factory Jul 28 16:35:51.537854 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.537792 2563 factory.go:223] Registration of the systemd container factory successfully Jul 28 16:35:51.538041 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.538020 2563 factory.go:153] Registering CRI-O factory Jul 28 16:35:51.538097 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.538043 2563 factory.go:223] Registration of the crio container factory successfully Jul 28 16:35:51.538141 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.538101 2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 28 16:35:51.538141 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.538127 2563 factory.go:103] Registering Raw factory Jul 28 16:35:51.538237 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.538144 2563 manager.go:1196] Started watching for new ooms in manager Jul 28 16:35:51.538816 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.538801 2563 manager.go:349] Starting recovery of all containers Jul 28 16:35:51.539984 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:51.539903 2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-245.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 28 16:35:51.540222 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:51.540195 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 28 16:35:51.540817 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:51.539901 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-245.ec2.internal.18c6815ffacaae2f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-245.ec2.internal,UID:ip-10-0-140-245.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-245.ec2.internal,},FirstTimestamp:2026-07-28 16:35:51.528443439 +0000 UTC m=+0.322239704,LastTimestamp:2026-07-28 16:35:51.528443439 +0000 UTC m=+0.322239704,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-245.ec2.internal,}" Jul 28 16:35:51.549752 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.549409 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r8w4v" Jul 28 16:35:51.551285 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.551273 2563 manager.go:354] Recovery completed Jul 28 16:35:51.555072 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.555061 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 16:35:51.556565 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.556542 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-245.ec2.internal" event="NodeHasSufficientMemory" Jul 28 16:35:51.556653 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.556573 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-245.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 16:35:51.556653 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.556584 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-245.ec2.internal" event="NodeHasSufficientPID" Jul 28 16:35:51.557158 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.557146 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 16:35:51.557219 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.557146 2563 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 28 16:35:51.557219 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.557207 2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 28 16:35:51.557219 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.557221 2563 state_mem.go:36] "Initialized new in-memory state store" Jul 28 16:35:51.557787 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.557775 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-245.ec2.internal" event="NodeHasSufficientMemory" Jul 28 16:35:51.557827 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.557799 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-245.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 16:35:51.557827 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.557810 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-245.ec2.internal" event="NodeHasSufficientPID" Jul 28 16:35:51.558679 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:51.558585 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-245.ec2.internal.18c6815ffc77acf9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-245.ec2.internal,UID:ip-10-0-140-245.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-245.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-245.ec2.internal,},FirstTimestamp:2026-07-28 16:35:51.556558073 +0000 UTC m=+0.350354337,LastTimestamp:2026-07-28 16:35:51.556558073 +0000 UTC m=+0.350354337,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-245.ec2.internal,}" Jul 28 16:35:51.558877 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.558866 2563 policy_none.go:49] "None policy: Start" Jul 28 16:35:51.558911 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.558881 2563 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 28 16:35:51.558911 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.558891 2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 28 16:35:51.559945 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.559933 2563 policy_none.go:47] "Start" Jul 28 16:35:51.594142 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.594129 2563 manager.go:337] "Starting Device Plugin manager" Jul 28 16:35:51.594230 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:51.594158 2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 28 16:35:51.594230 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.594168 2563 server.go:87] "Starting device plugin registration server" Jul 28 16:35:51.594671 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.594627 2563 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 28 16:35:51.594671 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.594649 2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 28 16:35:51.594793 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.594765 2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 28 16:35:51.595221 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.594871 2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 28 16:35:51.595221 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.594889 2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 28 16:35:51.595816 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:51.595799 2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 28 16:35:51.595894 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:51.595839 2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-245.ec2.internal\" not found" Jul 28 16:35:51.695817 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.695792 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 16:35:51.696875 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.696797 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-245.ec2.internal" event="NodeHasSufficientMemory" Jul 28 16:35:51.696875 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.696828 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-245.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 16:35:51.696875 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.696840 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-245.ec2.internal" event="NodeHasSufficientPID" Jul 28 16:35:51.696875 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.696875 2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-245.ec2.internal" Jul 28 16:35:51.702729 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.702714 2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-245.ec2.internal" Jul 28 16:35:51.702800 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:51.702737 2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-245.ec2.internal\": node \"ip-10-0-140-245.ec2.internal\" not found" Jul 28 16:35:51.715699 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:51.715654 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-245.ec2.internal\" not found" Jul 28 16:35:51.721673 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.721655 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 28 16:35:51.722884 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.722866 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 28 16:35:51.722958 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.722910 2563 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 28 16:35:51.722958 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.722932 2563 kubelet.go:2448] "Starting kubelet main sync loop" Jul 28 16:35:51.723040 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:51.722968 2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 28 16:35:51.725048 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.725032 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 16:35:51.816090 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:51.816048 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-245.ec2.internal\" not found" Jul 28 16:35:51.823214 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.823186 2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-245.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-245.ec2.internal"] Jul 28 16:35:51.823309 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.823290 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 16:35:51.824252 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.824232 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-245.ec2.internal" event="NodeHasSufficientMemory" Jul 28 16:35:51.824351 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.824266 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-245.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 16:35:51.824351 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.824281 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-245.ec2.internal" event="NodeHasSufficientPID" Jul 28 16:35:51.825393 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.825380 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 16:35:51.825563 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.825526 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-245.ec2.internal" Jul 28 16:35:51.825563 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.825560 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 16:35:51.826080 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.826067 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-245.ec2.internal" event="NodeHasSufficientMemory" Jul 28 16:35:51.826080 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.826078 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-245.ec2.internal" event="NodeHasSufficientMemory" Jul 28 16:35:51.826190 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.826095 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-245.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 16:35:51.826190 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.826095 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-245.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 16:35:51.826190 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.826121 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-245.ec2.internal" event="NodeHasSufficientPID" Jul 28 16:35:51.826190 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.826105 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-245.ec2.internal" event="NodeHasSufficientPID" Jul 28 16:35:51.827373 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.827358 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-245.ec2.internal" Jul 28 16:35:51.827427 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.827389 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 16:35:51.828012 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.827998 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-245.ec2.internal" event="NodeHasSufficientMemory" Jul 28 16:35:51.828064 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.828024 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-245.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 16:35:51.828064 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.828038 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-245.ec2.internal" event="NodeHasSufficientPID" Jul 28 16:35:51.838414 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.838398 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0e448a3525fc7835a6d30329884309d8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-245.ec2.internal\" (UID: \"0e448a3525fc7835a6d30329884309d8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-245.ec2.internal" Jul 28 16:35:51.838492 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.838419 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e448a3525fc7835a6d30329884309d8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-245.ec2.internal\" (UID: \"0e448a3525fc7835a6d30329884309d8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-245.ec2.internal" Jul 28 16:35:51.838492 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.838436 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/538e10424abd3b03414a01fd5ea53009-config\") pod \"kube-apiserver-proxy-ip-10-0-140-245.ec2.internal\" (UID: \"538e10424abd3b03414a01fd5ea53009\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-245.ec2.internal" Jul 28 16:35:51.860261 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:51.860243 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-245.ec2.internal\" not found" node="ip-10-0-140-245.ec2.internal" Jul 28 16:35:51.864476 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:51.864462 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-245.ec2.internal\" not found" node="ip-10-0-140-245.ec2.internal" Jul 28 16:35:51.916604 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:51.916580 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-245.ec2.internal\" not found" Jul 28 16:35:51.938783 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.938759 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0e448a3525fc7835a6d30329884309d8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-245.ec2.internal\" (UID: \"0e448a3525fc7835a6d30329884309d8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-245.ec2.internal" Jul 28 16:35:51.938882 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.938791 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e448a3525fc7835a6d30329884309d8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-245.ec2.internal\" (UID: \"0e448a3525fc7835a6d30329884309d8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-245.ec2.internal" Jul 28 16:35:51.938882 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.938813 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/538e10424abd3b03414a01fd5ea53009-config\") pod \"kube-apiserver-proxy-ip-10-0-140-245.ec2.internal\" (UID: \"538e10424abd3b03414a01fd5ea53009\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-245.ec2.internal" Jul 28 16:35:51.938882 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.938843 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0e448a3525fc7835a6d30329884309d8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-245.ec2.internal\" (UID: \"0e448a3525fc7835a6d30329884309d8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-245.ec2.internal" Jul 28 16:35:51.938882 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.938848 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e448a3525fc7835a6d30329884309d8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-245.ec2.internal\" (UID: \"0e448a3525fc7835a6d30329884309d8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-245.ec2.internal" Jul 28 16:35:51.938882 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:51.938868 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/538e10424abd3b03414a01fd5ea53009-config\") pod \"kube-apiserver-proxy-ip-10-0-140-245.ec2.internal\" (UID: \"538e10424abd3b03414a01fd5ea53009\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-245.ec2.internal" Jul 28 16:35:52.017117 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:52.017032 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-245.ec2.internal\" not found" Jul 28 16:35:52.117646 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:52.117590 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-245.ec2.internal\" not found" Jul 28 16:35:52.163060 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:52.163034 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-245.ec2.internal" Jul 28 16:35:52.168431 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:52.168406 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-245.ec2.internal" Jul 28 16:35:52.218368 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:52.218330 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-245.ec2.internal\" not found" Jul 28 16:35:52.318858 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:52.318776 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-245.ec2.internal\" not found" Jul 28 16:35:52.419187 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:52.419138 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-245.ec2.internal\" not found" Jul 28 16:35:52.478579 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:52.478545 2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 28 16:35:52.479163 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:52.478736 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 28 16:35:52.520014 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:52.519961 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-245.ec2.internal\" not found" Jul 28 16:35:52.554721 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:52.554684 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 16:30:51 +0000 UTC" deadline="2028-03-09 04:09:50.037674192 +0000 UTC" Jul 28 16:35:52.554721 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:52.554712 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14147h33m57.482964988s" Jul 28 16:35:52.621151 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:52.621084 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-245.ec2.internal\" not found" Jul 28 16:35:52.721658 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:52.721600 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-245.ec2.internal\" not found" Jul 28 16:35:52.744112 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:52.744076 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod538e10424abd3b03414a01fd5ea53009.slice/crio-45923cb8f27ea181d756f4ee11d30aceba70d71626b2c06128d79f3c5f0a5667 WatchSource:0}: Error finding container 45923cb8f27ea181d756f4ee11d30aceba70d71626b2c06128d79f3c5f0a5667: Status 404 returned error can't find the container with id 45923cb8f27ea181d756f4ee11d30aceba70d71626b2c06128d79f3c5f0a5667 Jul 28 16:35:52.744315 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:52.744289 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e448a3525fc7835a6d30329884309d8.slice/crio-f7617cc7b2250363ecc077ec8b447c0fcdc2f2b750842875f9e6ee039a576f72 WatchSource:0}: Error finding container f7617cc7b2250363ecc077ec8b447c0fcdc2f2b750842875f9e6ee039a576f72: Status 404 returned error can't find the container with id f7617cc7b2250363ecc077ec8b447c0fcdc2f2b750842875f9e6ee039a576f72 Jul 28 16:35:52.749098 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:52.749078 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 16:35:52.750335 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:52.750318 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 16:35:52.822747 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:52.822702 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-245.ec2.internal\" not found" Jul 28 16:35:52.923511 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:52.923434 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-245.ec2.internal\" not found" Jul 28 16:35:52.928475 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:52.928456 2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 16:35:52.937753 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:52.937737 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-245.ec2.internal" Jul 28 16:35:52.949388 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:52.949369 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 16:35:52.951072 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:52.951059 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-245.ec2.internal" Jul 28 16:35:52.959848 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:52.959832 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 16:35:53.079145 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.079107 2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 16:35:53.519089 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.519058 2563 apiserver.go:52] "Watching apiserver" Jul 28 16:35:53.527856 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.527820 2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 28 16:35:53.528303 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.528269 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-fdgv8","kube-system/kube-apiserver-proxy-ip-10-0-140-245.ec2.internal","openshift-cluster-node-tuning-operator/tuned-kwxqv","openshift-dns/node-resolver-xr8r8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-245.ec2.internal","openshift-multus/multus-additional-cni-plugins-4zxv6","openshift-multus/multus-q82xs","openshift-multus/network-metrics-daemon-q6dz7","kube-system/konnectivity-agent-pwcjg","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tlxzt","openshift-image-registry/node-ca-4899s","openshift-network-diagnostics/network-check-target-wq5zz","openshift-network-operator/iptables-alerter-shk5x","openshift-ovn-kubernetes/ovnkube-node-vjvs7"] Jul 28 16:35:53.530034 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.530013 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q82xs" Jul 28 16:35:53.531721 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.531700 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4899s" Jul 28 16:35:53.533324 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.532671 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kwxqv" Jul 28 16:35:53.533324 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.533148 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 28 16:35:53.533324 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.533207 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 28 16:35:53.533324 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.533215 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 28 16:35:53.533324 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.533216 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 28 16:35:53.533626 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.533431 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-klwnh\"" Jul 28 16:35:53.534052 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.534031 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xr8r8" Jul 28 16:35:53.534052 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.534045 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 28 16:35:53.534602 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.534451 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 28 16:35:53.534602 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.534462 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qkq46\"" Jul 28 16:35:53.534602 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.534499 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 28 16:35:53.535111 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.535072 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 28 16:35:53.535458 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.535273 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-d47bv\"" Jul 28 16:35:53.535458 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.535279 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 28 16:35:53.535902 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.535887 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.536833 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.536817 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 28 16:35:53.536833 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.536818 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-v8tb2\"" Jul 28 16:35:53.537248 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.537096 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 28 16:35:53.537592 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.537568 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4zxv6" Jul 28 16:35:53.538095 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.538075 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 28 16:35:53.539457 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.539435 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pwcjg" Jul 28 16:35:53.539778 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.539757 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 28 16:35:53.541126 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.541109 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-shk5x" Jul 28 16:35:53.541309 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.541290 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 28 16:35:53.541397 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.541344 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-s7864\"" Jul 28 16:35:53.542569 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.541947 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 28 16:35:53.542569 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.542138 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-42dfw\"" Jul 28 16:35:53.542569 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.542256 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 28 16:35:53.542784 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.542594 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 28 16:35:53.542784 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.542684 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 28 16:35:53.542784 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.542694 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 28 16:35:53.544096 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.541294 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 28 16:35:53.544096 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.543849 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 28 16:35:53.544096 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.543956 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-p65wl\"" Jul 28 16:35:53.544667 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.544632 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 28 16:35:53.546048 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.545220 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6dz7" Jul 28 16:35:53.546048 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:53.545329 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6dz7" podUID="da54b8f0-8ec1-4b28-a76b-037edb5bec20" Jul 28 16:35:53.547166 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.547147 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 28 16:35:53.548931 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.548892 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tlxzt" Jul 28 16:35:53.549020 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.548940 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/258401ce-b809-4fe8-8c76-f64168a32d6e-agent-certs\") pod \"konnectivity-agent-pwcjg\" (UID: \"258401ce-b809-4fe8-8c76-f64168a32d6e\") " pod="kube-system/konnectivity-agent-pwcjg" Jul 28 16:35:53.549020 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.548968 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/258401ce-b809-4fe8-8c76-f64168a32d6e-konnectivity-ca\") pod \"konnectivity-agent-pwcjg\" (UID: \"258401ce-b809-4fe8-8c76-f64168a32d6e\") " pod="kube-system/konnectivity-agent-pwcjg" Jul 28 16:35:53.549020 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.548993 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6ba0ffc7-9736-4f5e-86de-52a97b2a17e7-host-run-multus-certs\") pod \"multus-q82xs\" (UID: \"6ba0ffc7-9736-4f5e-86de-52a97b2a17e7\") " pod="openshift-multus/multus-q82xs" Jul 28 16:35:53.549177 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.549021 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/90ae3dbc-89ae-4464-b7db-3152c533ee19-etc-systemd\") pod \"tuned-kwxqv\" (UID: \"90ae3dbc-89ae-4464-b7db-3152c533ee19\") " pod="openshift-cluster-node-tuning-operator/tuned-kwxqv" Jul 28 16:35:53.549177 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.549048 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/021148b1-76cd-486f-a99d-e45527a9323e-host-run-netns\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.549177 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.549089 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/021148b1-76cd-486f-a99d-e45527a9323e-host-cni-netd\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.549177 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.549120 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6ba0ffc7-9736-4f5e-86de-52a97b2a17e7-host-var-lib-cni-multus\") pod \"multus-q82xs\" (UID: \"6ba0ffc7-9736-4f5e-86de-52a97b2a17e7\") " pod="openshift-multus/multus-q82xs" Jul 28 16:35:53.549177 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.549146 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0f2ba44-e234-4d76-9d0d-a152fd55e253-tmp-dir\") pod \"node-resolver-xr8r8\" (UID: \"f0f2ba44-e234-4d76-9d0d-a152fd55e253\") " pod="openshift-dns/node-resolver-xr8r8" Jul 28 16:35:53.549410 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.549205 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/90ae3dbc-89ae-4464-b7db-3152c533ee19-etc-sysctl-conf\") pod \"tuned-kwxqv\" (UID: \"90ae3dbc-89ae-4464-b7db-3152c533ee19\") " pod="openshift-cluster-node-tuning-operator/tuned-kwxqv" Jul 28 16:35:53.549410 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.549235 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6ba0ffc7-9736-4f5e-86de-52a97b2a17e7-cni-binary-copy\") pod \"multus-q82xs\" (UID: \"6ba0ffc7-9736-4f5e-86de-52a97b2a17e7\") " pod="openshift-multus/multus-q82xs" Jul 28 16:35:53.549410 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.549258 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2613b1fa-f3a0-4a1b-a90c-029c1a1dae6d-host\") pod \"node-ca-4899s\" (UID: \"2613b1fa-f3a0-4a1b-a90c-029c1a1dae6d\") " pod="openshift-image-registry/node-ca-4899s" Jul 28 16:35:53.549410 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.549281 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8lxk\" (UniqueName: \"kubernetes.io/projected/2613b1fa-f3a0-4a1b-a90c-029c1a1dae6d-kube-api-access-k8lxk\") pod \"node-ca-4899s\" (UID: \"2613b1fa-f3a0-4a1b-a90c-029c1a1dae6d\") " pod="openshift-image-registry/node-ca-4899s" Jul 28 16:35:53.549410 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.549305 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/021148b1-76cd-486f-a99d-e45527a9323e-log-socket\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.549410 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.549343 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdml7\" (UniqueName: \"kubernetes.io/projected/021148b1-76cd-486f-a99d-e45527a9323e-kube-api-access-gdml7\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.549410 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.549383 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/021148b1-76cd-486f-a99d-e45527a9323e-var-lib-openvswitch\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.549410 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.549409 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/eb488c90-4340-45eb-bb7b-003ef9ca81d1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4zxv6\" (UID: \"eb488c90-4340-45eb-bb7b-003ef9ca81d1\") " pod="openshift-multus/multus-additional-cni-plugins-4zxv6" Jul 28 16:35:53.549814 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.549433 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6ba0ffc7-9736-4f5e-86de-52a97b2a17e7-multus-socket-dir-parent\") pod \"multus-q82xs\" (UID: \"6ba0ffc7-9736-4f5e-86de-52a97b2a17e7\") " pod="openshift-multus/multus-q82xs" Jul 28 16:35:53.549814 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.549469 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6ba0ffc7-9736-4f5e-86de-52a97b2a17e7-multus-conf-dir\") pod \"multus-q82xs\" (UID: \"6ba0ffc7-9736-4f5e-86de-52a97b2a17e7\") " pod="openshift-multus/multus-q82xs" Jul 28 16:35:53.549814 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.549511 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/021148b1-76cd-486f-a99d-e45527a9323e-host-cni-bin\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.549814 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.549536 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/021148b1-76cd-486f-a99d-e45527a9323e-env-overrides\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.549814 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.549559 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/021148b1-76cd-486f-a99d-e45527a9323e-ovnkube-script-lib\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.549814 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.549585 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eb488c90-4340-45eb-bb7b-003ef9ca81d1-system-cni-dir\") pod \"multus-additional-cni-plugins-4zxv6\" (UID: \"eb488c90-4340-45eb-bb7b-003ef9ca81d1\") " pod="openshift-multus/multus-additional-cni-plugins-4zxv6" Jul 28 16:35:53.549814 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.549631 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6ba0ffc7-9736-4f5e-86de-52a97b2a17e7-multus-daemon-config\") pod \"multus-q82xs\" (UID: \"6ba0ffc7-9736-4f5e-86de-52a97b2a17e7\") " pod="openshift-multus/multus-q82xs" Jul 28 16:35:53.549814 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.549654 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/021148b1-76cd-486f-a99d-e45527a9323e-run-ovn\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.549814 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.549691 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/90ae3dbc-89ae-4464-b7db-3152c533ee19-etc-kubernetes\") pod \"tuned-kwxqv\" (UID: \"90ae3dbc-89ae-4464-b7db-3152c533ee19\") " pod="openshift-cluster-node-tuning-operator/tuned-kwxqv" Jul 28 16:35:53.549814 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.549714 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90ae3dbc-89ae-4464-b7db-3152c533ee19-tmp\") pod \"tuned-kwxqv\" (UID: \"90ae3dbc-89ae-4464-b7db-3152c533ee19\") " pod="openshift-cluster-node-tuning-operator/tuned-kwxqv" Jul 28 16:35:53.549814 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.549734 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 28 16:35:53.549814 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.549760 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-s5n8d\"" Jul 28 16:35:53.549814 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.549790 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 16:35:53.549814 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.549736 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6ba0ffc7-9736-4f5e-86de-52a97b2a17e7-system-cni-dir\") pod \"multus-q82xs\" (UID: \"6ba0ffc7-9736-4f5e-86de-52a97b2a17e7\") " pod="openshift-multus/multus-q82xs" Jul 28 16:35:53.550457 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.549737 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 28 16:35:53.550457 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.549862 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ba0ffc7-9736-4f5e-86de-52a97b2a17e7-etc-kubernetes\") pod \"multus-q82xs\" (UID: \"6ba0ffc7-9736-4f5e-86de-52a97b2a17e7\") " pod="openshift-multus/multus-q82xs" Jul 28 16:35:53.550457 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.549911 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmfws\" (UniqueName: \"kubernetes.io/projected/6ba0ffc7-9736-4f5e-86de-52a97b2a17e7-kube-api-access-hmfws\") pod \"multus-q82xs\" (UID: \"6ba0ffc7-9736-4f5e-86de-52a97b2a17e7\") " pod="openshift-multus/multus-q82xs" Jul 28 16:35:53.550457 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.549947 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/90ae3dbc-89ae-4464-b7db-3152c533ee19-etc-sysconfig\") pod \"tuned-kwxqv\" (UID: \"90ae3dbc-89ae-4464-b7db-3152c533ee19\") " pod="openshift-cluster-node-tuning-operator/tuned-kwxqv" Jul 28 16:35:53.550457 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.549971 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/021148b1-76cd-486f-a99d-e45527a9323e-systemd-units\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.550457 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.549994 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/021148b1-76cd-486f-a99d-e45527a9323e-etc-openvswitch\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.550457 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.550016 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/021148b1-76cd-486f-a99d-e45527a9323e-ovnkube-config\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.550457 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.550050 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6ba0ffc7-9736-4f5e-86de-52a97b2a17e7-hostroot\") pod \"multus-q82xs\" (UID: \"6ba0ffc7-9736-4f5e-86de-52a97b2a17e7\") " pod="openshift-multus/multus-q82xs" Jul 28 16:35:53.550457 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.550078 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90ae3dbc-89ae-4464-b7db-3152c533ee19-var-lib-kubelet\") pod \"tuned-kwxqv\" (UID: \"90ae3dbc-89ae-4464-b7db-3152c533ee19\") " pod="openshift-cluster-node-tuning-operator/tuned-kwxqv" Jul 28 16:35:53.550457 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.550103 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eb488c90-4340-45eb-bb7b-003ef9ca81d1-cnibin\") pod \"multus-additional-cni-plugins-4zxv6\" (UID: \"eb488c90-4340-45eb-bb7b-003ef9ca81d1\") " pod="openshift-multus/multus-additional-cni-plugins-4zxv6" Jul 28 16:35:53.550457 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.550127 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bnph\" (UniqueName: \"kubernetes.io/projected/f0f2ba44-e234-4d76-9d0d-a152fd55e253-kube-api-access-4bnph\") pod \"node-resolver-xr8r8\" (UID: \"f0f2ba44-e234-4d76-9d0d-a152fd55e253\") " pod="openshift-dns/node-resolver-xr8r8" Jul 28 16:35:53.550457 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.550150 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/90ae3dbc-89ae-4464-b7db-3152c533ee19-lib-modules\") pod \"tuned-kwxqv\" (UID: \"90ae3dbc-89ae-4464-b7db-3152c533ee19\") " pod="openshift-cluster-node-tuning-operator/tuned-kwxqv" Jul 28 16:35:53.550457 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.550174 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/90ae3dbc-89ae-4464-b7db-3152c533ee19-etc-tuned\") pod \"tuned-kwxqv\" (UID: \"90ae3dbc-89ae-4464-b7db-3152c533ee19\") " pod="openshift-cluster-node-tuning-operator/tuned-kwxqv" Jul 28 16:35:53.550457 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.550201 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/021148b1-76cd-486f-a99d-e45527a9323e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.550457 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.550226 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6ba0ffc7-9736-4f5e-86de-52a97b2a17e7-host-run-k8s-cni-cncf-io\") pod \"multus-q82xs\" (UID: \"6ba0ffc7-9736-4f5e-86de-52a97b2a17e7\") " pod="openshift-multus/multus-q82xs" Jul 28 16:35:53.550457 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.550247 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6ba0ffc7-9736-4f5e-86de-52a97b2a17e7-host-run-netns\") pod \"multus-q82xs\" (UID: \"6ba0ffc7-9736-4f5e-86de-52a97b2a17e7\") " pod="openshift-multus/multus-q82xs" Jul 28 16:35:53.550457 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.550270 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ba0ffc7-9736-4f5e-86de-52a97b2a17e7-host-var-lib-kubelet\") pod \"multus-q82xs\" (UID: \"6ba0ffc7-9736-4f5e-86de-52a97b2a17e7\") " pod="openshift-multus/multus-q82xs" Jul 28 16:35:53.551291 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.550304 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/90ae3dbc-89ae-4464-b7db-3152c533ee19-run\") pod \"tuned-kwxqv\" (UID: \"90ae3dbc-89ae-4464-b7db-3152c533ee19\") " pod="openshift-cluster-node-tuning-operator/tuned-kwxqv" Jul 28 16:35:53.551291 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.550330 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/90ae3dbc-89ae-4464-b7db-3152c533ee19-host\") pod \"tuned-kwxqv\" (UID: \"90ae3dbc-89ae-4464-b7db-3152c533ee19\") " pod="openshift-cluster-node-tuning-operator/tuned-kwxqv" Jul 28 16:35:53.551291 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.550356 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/021148b1-76cd-486f-a99d-e45527a9323e-host-run-ovn-kubernetes\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.551291 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.550378 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/eb488c90-4340-45eb-bb7b-003ef9ca81d1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4zxv6\" (UID: \"eb488c90-4340-45eb-bb7b-003ef9ca81d1\") " pod="openshift-multus/multus-additional-cni-plugins-4zxv6" Jul 28 16:35:53.551291 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.550398 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eb488c90-4340-45eb-bb7b-003ef9ca81d1-os-release\") pod \"multus-additional-cni-plugins-4zxv6\" (UID: \"eb488c90-4340-45eb-bb7b-003ef9ca81d1\") " pod="openshift-multus/multus-additional-cni-plugins-4zxv6" Jul 28 16:35:53.551291 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.550419 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6ba0ffc7-9736-4f5e-86de-52a97b2a17e7-multus-cni-dir\") pod \"multus-q82xs\" (UID: \"6ba0ffc7-9736-4f5e-86de-52a97b2a17e7\") " pod="openshift-multus/multus-q82xs" Jul 28 16:35:53.551291 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.550443 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6ba0ffc7-9736-4f5e-86de-52a97b2a17e7-host-var-lib-cni-bin\") pod \"multus-q82xs\" (UID: \"6ba0ffc7-9736-4f5e-86de-52a97b2a17e7\") " pod="openshift-multus/multus-q82xs" Jul 28 16:35:53.551291 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.550467 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2613b1fa-f3a0-4a1b-a90c-029c1a1dae6d-serviceca\") pod \"node-ca-4899s\" (UID: \"2613b1fa-f3a0-4a1b-a90c-029c1a1dae6d\") " pod="openshift-image-registry/node-ca-4899s" Jul 28 16:35:53.551291 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.550483 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f0f2ba44-e234-4d76-9d0d-a152fd55e253-hosts-file\") pod \"node-resolver-xr8r8\" (UID: \"f0f2ba44-e234-4d76-9d0d-a152fd55e253\") " pod="openshift-dns/node-resolver-xr8r8" Jul 28 16:35:53.551291 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.550509 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/90ae3dbc-89ae-4464-b7db-3152c533ee19-etc-sysctl-d\") pod \"tuned-kwxqv\" (UID: \"90ae3dbc-89ae-4464-b7db-3152c533ee19\") " pod="openshift-cluster-node-tuning-operator/tuned-kwxqv" Jul 28 16:35:53.551291 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.550540 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/90ae3dbc-89ae-4464-b7db-3152c533ee19-sys\") pod \"tuned-kwxqv\" (UID: \"90ae3dbc-89ae-4464-b7db-3152c533ee19\") " pod="openshift-cluster-node-tuning-operator/tuned-kwxqv" Jul 28 16:35:53.551291 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.550564 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eb488c90-4340-45eb-bb7b-003ef9ca81d1-cni-binary-copy\") pod \"multus-additional-cni-plugins-4zxv6\" (UID: \"eb488c90-4340-45eb-bb7b-003ef9ca81d1\") " pod="openshift-multus/multus-additional-cni-plugins-4zxv6" Jul 28 16:35:53.551291 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.550580 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/021148b1-76cd-486f-a99d-e45527a9323e-host-slash\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.551291 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.550636 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/021148b1-76cd-486f-a99d-e45527a9323e-run-systemd\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.551291 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.550662 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/021148b1-76cd-486f-a99d-e45527a9323e-ovn-node-metrics-cert\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.551291 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.550703 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eb488c90-4340-45eb-bb7b-003ef9ca81d1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4zxv6\" (UID: \"eb488c90-4340-45eb-bb7b-003ef9ca81d1\") " pod="openshift-multus/multus-additional-cni-plugins-4zxv6" Jul 28 16:35:53.552047 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.550719 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rbh7\" (UniqueName: \"kubernetes.io/projected/eb488c90-4340-45eb-bb7b-003ef9ca81d1-kube-api-access-7rbh7\") pod \"multus-additional-cni-plugins-4zxv6\" (UID: \"eb488c90-4340-45eb-bb7b-003ef9ca81d1\") " pod="openshift-multus/multus-additional-cni-plugins-4zxv6" Jul 28 16:35:53.552047 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.550742 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6ba0ffc7-9736-4f5e-86de-52a97b2a17e7-cnibin\") pod \"multus-q82xs\" (UID: \"6ba0ffc7-9736-4f5e-86de-52a97b2a17e7\") " pod="openshift-multus/multus-q82xs" Jul 28 16:35:53.552047 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.550764 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6ba0ffc7-9736-4f5e-86de-52a97b2a17e7-os-release\") pod \"multus-q82xs\" (UID: \"6ba0ffc7-9736-4f5e-86de-52a97b2a17e7\") " pod="openshift-multus/multus-q82xs" Jul 28 16:35:53.552047 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.550797 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/90ae3dbc-89ae-4464-b7db-3152c533ee19-etc-modprobe-d\") pod \"tuned-kwxqv\" (UID: \"90ae3dbc-89ae-4464-b7db-3152c533ee19\") " pod="openshift-cluster-node-tuning-operator/tuned-kwxqv" Jul 28 16:35:53.552047 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.550834 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/021148b1-76cd-486f-a99d-e45527a9323e-run-openvswitch\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.552047 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.550855 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/021148b1-76cd-486f-a99d-e45527a9323e-node-log\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.552047 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.550876 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5pjt\" (UniqueName: \"kubernetes.io/projected/90ae3dbc-89ae-4464-b7db-3152c533ee19-kube-api-access-w5pjt\") pod \"tuned-kwxqv\" (UID: \"90ae3dbc-89ae-4464-b7db-3152c533ee19\") " pod="openshift-cluster-node-tuning-operator/tuned-kwxqv" Jul 28 16:35:53.552047 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.550899 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/021148b1-76cd-486f-a99d-e45527a9323e-host-kubelet\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.552047 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.551562 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 28 16:35:53.552047 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.551575 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 28 16:35:53.552047 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.551741 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 28 16:35:53.552047 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.551834 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gvz5b\"" Jul 28 16:35:53.552786 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.552766 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdgv8" Jul 28 16:35:53.552855 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:53.552832 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdgv8" podUID="6bf1d484-4b82-487c-bcf1-be189dabfd24" Jul 28 16:35:53.554404 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.554377 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wq5zz" Jul 28 16:35:53.554488 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:53.554458 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wq5zz" podUID="45e07f9b-6993-4b7d-bf17-197b21c25a4b" Jul 28 16:35:53.568423 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.568400 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-9kdbt" Jul 28 16:35:53.579485 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.579466 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-9kdbt" Jul 28 16:35:53.639146 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.639126 2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 28 16:35:53.652118 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.652079 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/90ae3dbc-89ae-4464-b7db-3152c533ee19-etc-sysctl-conf\") pod \"tuned-kwxqv\" (UID: \"90ae3dbc-89ae-4464-b7db-3152c533ee19\") " pod="openshift-cluster-node-tuning-operator/tuned-kwxqv" Jul 28 16:35:53.652260 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.652127 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6ba0ffc7-9736-4f5e-86de-52a97b2a17e7-cni-binary-copy\") pod \"multus-q82xs\" (UID: \"6ba0ffc7-9736-4f5e-86de-52a97b2a17e7\") " pod="openshift-multus/multus-q82xs" Jul 28 16:35:53.652260 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.652150 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2613b1fa-f3a0-4a1b-a90c-029c1a1dae6d-host\") pod \"node-ca-4899s\" (UID: \"2613b1fa-f3a0-4a1b-a90c-029c1a1dae6d\") " pod="openshift-image-registry/node-ca-4899s" Jul 28 16:35:53.652260 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.652174 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8lxk\" (UniqueName: \"kubernetes.io/projected/2613b1fa-f3a0-4a1b-a90c-029c1a1dae6d-kube-api-access-k8lxk\") pod \"node-ca-4899s\" (UID: \"2613b1fa-f3a0-4a1b-a90c-029c1a1dae6d\") " pod="openshift-image-registry/node-ca-4899s" Jul 28 16:35:53.652260 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.652197 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/021148b1-76cd-486f-a99d-e45527a9323e-log-socket\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.652260 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.652238 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdml7\" (UniqueName: \"kubernetes.io/projected/021148b1-76cd-486f-a99d-e45527a9323e-kube-api-access-gdml7\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.652503 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.652281 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/90ae3dbc-89ae-4464-b7db-3152c533ee19-etc-sysctl-conf\") pod \"tuned-kwxqv\" (UID: \"90ae3dbc-89ae-4464-b7db-3152c533ee19\") " pod="openshift-cluster-node-tuning-operator/tuned-kwxqv" Jul 28 16:35:53.652503 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.652292 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2613b1fa-f3a0-4a1b-a90c-029c1a1dae6d-host\") pod \"node-ca-4899s\" (UID: \"2613b1fa-f3a0-4a1b-a90c-029c1a1dae6d\") " pod="openshift-image-registry/node-ca-4899s" Jul 28 16:35:53.652503 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.652375 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/021148b1-76cd-486f-a99d-e45527a9323e-log-socket\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.652503 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.652359 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bjjr\" (UniqueName: \"kubernetes.io/projected/c5a59f48-8e47-4505-97b6-01f136669bd8-kube-api-access-7bjjr\") pod \"aws-ebs-csi-driver-node-tlxzt\" (UID: \"c5a59f48-8e47-4505-97b6-01f136669bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tlxzt" Jul 28 16:35:53.652503 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.652416 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/021148b1-76cd-486f-a99d-e45527a9323e-var-lib-openvswitch\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.652503 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.652444 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/eb488c90-4340-45eb-bb7b-003ef9ca81d1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4zxv6\" (UID: \"eb488c90-4340-45eb-bb7b-003ef9ca81d1\") " pod="openshift-multus/multus-additional-cni-plugins-4zxv6" Jul 28 16:35:53.652806 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.652522 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6ba0ffc7-9736-4f5e-86de-52a97b2a17e7-multus-socket-dir-parent\") pod \"multus-q82xs\" (UID: \"6ba0ffc7-9736-4f5e-86de-52a97b2a17e7\") " pod="openshift-multus/multus-q82xs" Jul 28 16:35:53.652806 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.652545 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6ba0ffc7-9736-4f5e-86de-52a97b2a17e7-multus-conf-dir\") pod \"multus-q82xs\" (UID: \"6ba0ffc7-9736-4f5e-86de-52a97b2a17e7\") " pod="openshift-multus/multus-q82xs" Jul 28 16:35:53.652806 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.652572 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/021148b1-76cd-486f-a99d-e45527a9323e-host-cni-bin\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.652806 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.652631 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/021148b1-76cd-486f-a99d-e45527a9323e-env-overrides\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.652806 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.652651 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/021148b1-76cd-486f-a99d-e45527a9323e-ovnkube-script-lib\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.652806 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.652674 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eb488c90-4340-45eb-bb7b-003ef9ca81d1-system-cni-dir\") pod \"multus-additional-cni-plugins-4zxv6\" (UID: \"eb488c90-4340-45eb-bb7b-003ef9ca81d1\") " pod="openshift-multus/multus-additional-cni-plugins-4zxv6" Jul 28 16:35:53.652806 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.652710 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6ba0ffc7-9736-4f5e-86de-52a97b2a17e7-multus-daemon-config\") pod \"multus-q82xs\" (UID: \"6ba0ffc7-9736-4f5e-86de-52a97b2a17e7\") " pod="openshift-multus/multus-q82xs" Jul 28 16:35:53.652806 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.652760 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/021148b1-76cd-486f-a99d-e45527a9323e-host-cni-bin\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.652806 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.652796 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/021148b1-76cd-486f-a99d-e45527a9323e-run-ovn\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.653258 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.652823 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/90ae3dbc-89ae-4464-b7db-3152c533ee19-etc-kubernetes\") pod \"tuned-kwxqv\" (UID: \"90ae3dbc-89ae-4464-b7db-3152c533ee19\") " pod="openshift-cluster-node-tuning-operator/tuned-kwxqv" Jul 28 16:35:53.653258 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.652868 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90ae3dbc-89ae-4464-b7db-3152c533ee19-tmp\") pod \"tuned-kwxqv\" (UID: \"90ae3dbc-89ae-4464-b7db-3152c533ee19\") " pod="openshift-cluster-node-tuning-operator/tuned-kwxqv" Jul 28 16:35:53.653258 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.652907 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6ba0ffc7-9736-4f5e-86de-52a97b2a17e7-system-cni-dir\") pod \"multus-q82xs\" (UID: \"6ba0ffc7-9736-4f5e-86de-52a97b2a17e7\") " pod="openshift-multus/multus-q82xs" Jul 28 16:35:53.653258 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.652911 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6ba0ffc7-9736-4f5e-86de-52a97b2a17e7-cni-binary-copy\") pod \"multus-q82xs\" (UID: \"6ba0ffc7-9736-4f5e-86de-52a97b2a17e7\") " pod="openshift-multus/multus-q82xs" Jul 28 16:35:53.653258 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.652930 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ba0ffc7-9736-4f5e-86de-52a97b2a17e7-etc-kubernetes\") pod \"multus-q82xs\" (UID: \"6ba0ffc7-9736-4f5e-86de-52a97b2a17e7\") " pod="openshift-multus/multus-q82xs" Jul 28 16:35:53.653258 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.652960 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmfws\" (UniqueName: \"kubernetes.io/projected/6ba0ffc7-9736-4f5e-86de-52a97b2a17e7-kube-api-access-hmfws\") pod \"multus-q82xs\" (UID: \"6ba0ffc7-9736-4f5e-86de-52a97b2a17e7\") " pod="openshift-multus/multus-q82xs" Jul 28 16:35:53.653258 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.653005 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da54b8f0-8ec1-4b28-a76b-037edb5bec20-metrics-certs\") pod \"network-metrics-daemon-q6dz7\" (UID: \"da54b8f0-8ec1-4b28-a76b-037edb5bec20\") " pod="openshift-multus/network-metrics-daemon-q6dz7" Jul 28 16:35:53.653258 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.653056 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/90ae3dbc-89ae-4464-b7db-3152c533ee19-etc-sysconfig\") pod \"tuned-kwxqv\" (UID: \"90ae3dbc-89ae-4464-b7db-3152c533ee19\") " pod="openshift-cluster-node-tuning-operator/tuned-kwxqv" Jul 28 16:35:53.653258 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.653119 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/021148b1-76cd-486f-a99d-e45527a9323e-systemd-units\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.653258 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.653159 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/021148b1-76cd-486f-a99d-e45527a9323e-etc-openvswitch\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.653258 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.653183 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/021148b1-76cd-486f-a99d-e45527a9323e-ovnkube-config\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.653258 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.653255 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6ba0ffc7-9736-4f5e-86de-52a97b2a17e7-hostroot\") pod \"multus-q82xs\" (UID: \"6ba0ffc7-9736-4f5e-86de-52a97b2a17e7\") " pod="openshift-multus/multus-q82xs" Jul 28 16:35:53.653830 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.653268 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/eb488c90-4340-45eb-bb7b-003ef9ca81d1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4zxv6\" (UID: \"eb488c90-4340-45eb-bb7b-003ef9ca81d1\") " pod="openshift-multus/multus-additional-cni-plugins-4zxv6" Jul 28 16:35:53.653830 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.653280 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6bf1d484-4b82-487c-bcf1-be189dabfd24-kubelet-config\") pod \"global-pull-secret-syncer-fdgv8\" (UID: \"6bf1d484-4b82-487c-bcf1-be189dabfd24\") " pod="kube-system/global-pull-secret-syncer-fdgv8" Jul 28 16:35:53.653830 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.653319 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90ae3dbc-89ae-4464-b7db-3152c533ee19-var-lib-kubelet\") pod \"tuned-kwxqv\" (UID: \"90ae3dbc-89ae-4464-b7db-3152c533ee19\") " pod="openshift-cluster-node-tuning-operator/tuned-kwxqv" Jul 28 16:35:53.653830 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.653342 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c5a59f48-8e47-4505-97b6-01f136669bd8-socket-dir\") pod \"aws-ebs-csi-driver-node-tlxzt\" (UID: \"c5a59f48-8e47-4505-97b6-01f136669bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tlxzt" Jul 28 16:35:53.653830 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.653344 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/021148b1-76cd-486f-a99d-e45527a9323e-var-lib-openvswitch\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.653830 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.653348 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6ba0ffc7-9736-4f5e-86de-52a97b2a17e7-multus-daemon-config\") pod \"multus-q82xs\" (UID: \"6ba0ffc7-9736-4f5e-86de-52a97b2a17e7\") " pod="openshift-multus/multus-q82xs" Jul 28 16:35:53.653830 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.653366 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xftt8\" (UniqueName: \"kubernetes.io/projected/45e07f9b-6993-4b7d-bf17-197b21c25a4b-kube-api-access-xftt8\") pod \"network-check-target-wq5zz\" (UID: \"45e07f9b-6993-4b7d-bf17-197b21c25a4b\") " pod="openshift-network-diagnostics/network-check-target-wq5zz" Jul 28 16:35:53.653830 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.653395 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eb488c90-4340-45eb-bb7b-003ef9ca81d1-system-cni-dir\") pod \"multus-additional-cni-plugins-4zxv6\" (UID: \"eb488c90-4340-45eb-bb7b-003ef9ca81d1\") " pod="openshift-multus/multus-additional-cni-plugins-4zxv6" Jul 28 16:35:53.653830 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.653408 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eb488c90-4340-45eb-bb7b-003ef9ca81d1-cnibin\") pod \"multus-additional-cni-plugins-4zxv6\" (UID: \"eb488c90-4340-45eb-bb7b-003ef9ca81d1\") " pod="openshift-multus/multus-additional-cni-plugins-4zxv6" Jul 28 16:35:53.653830 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.653445 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bnph\" (UniqueName: \"kubernetes.io/projected/f0f2ba44-e234-4d76-9d0d-a152fd55e253-kube-api-access-4bnph\") pod \"node-resolver-xr8r8\" (UID: \"f0f2ba44-e234-4d76-9d0d-a152fd55e253\") " pod="openshift-dns/node-resolver-xr8r8" Jul 28 16:35:53.653830 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.653466 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6ba0ffc7-9736-4f5e-86de-52a97b2a17e7-multus-socket-dir-parent\") pod \"multus-q82xs\" (UID: \"6ba0ffc7-9736-4f5e-86de-52a97b2a17e7\") " pod="openshift-multus/multus-q82xs" Jul 28 16:35:53.653830 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.653479 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhhcw\" (UniqueName: \"kubernetes.io/projected/da54b8f0-8ec1-4b28-a76b-037edb5bec20-kube-api-access-rhhcw\") pod \"network-metrics-daemon-q6dz7\" (UID: \"da54b8f0-8ec1-4b28-a76b-037edb5bec20\") " pod="openshift-multus/network-metrics-daemon-q6dz7" Jul 28 16:35:53.653830 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.653517 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/90ae3dbc-89ae-4464-b7db-3152c533ee19-etc-sysconfig\") pod \"tuned-kwxqv\" (UID: \"90ae3dbc-89ae-4464-b7db-3152c533ee19\") " pod="openshift-cluster-node-tuning-operator/tuned-kwxqv" Jul 28 16:35:53.653830 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.653530 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/021148b1-76cd-486f-a99d-e45527a9323e-systemd-units\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.653830 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.653521 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/90ae3dbc-89ae-4464-b7db-3152c533ee19-lib-modules\") pod \"tuned-kwxqv\" (UID: \"90ae3dbc-89ae-4464-b7db-3152c533ee19\") " pod="openshift-cluster-node-tuning-operator/tuned-kwxqv" Jul 28 16:35:53.653830 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.653554 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6ba0ffc7-9736-4f5e-86de-52a97b2a17e7-multus-conf-dir\") pod \"multus-q82xs\" (UID: \"6ba0ffc7-9736-4f5e-86de-52a97b2a17e7\") " pod="openshift-multus/multus-q82xs" Jul 28 16:35:53.653830 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.653593 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/021148b1-76cd-486f-a99d-e45527a9323e-run-ovn\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.654624 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.653647 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/021148b1-76cd-486f-a99d-e45527a9323e-ovnkube-script-lib\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.654624 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.653651 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/90ae3dbc-89ae-4464-b7db-3152c533ee19-etc-kubernetes\") pod \"tuned-kwxqv\" (UID: \"90ae3dbc-89ae-4464-b7db-3152c533ee19\") " pod="openshift-cluster-node-tuning-operator/tuned-kwxqv" Jul 28 16:35:53.654624 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.653676 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/90ae3dbc-89ae-4464-b7db-3152c533ee19-lib-modules\") pod \"tuned-kwxqv\" (UID: \"90ae3dbc-89ae-4464-b7db-3152c533ee19\") " pod="openshift-cluster-node-tuning-operator/tuned-kwxqv" Jul 28 16:35:53.654624 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.653721 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eb488c90-4340-45eb-bb7b-003ef9ca81d1-cnibin\") pod \"multus-additional-cni-plugins-4zxv6\" (UID: \"eb488c90-4340-45eb-bb7b-003ef9ca81d1\") " pod="openshift-multus/multus-additional-cni-plugins-4zxv6" Jul 28 16:35:53.654624 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.653796 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ba0ffc7-9736-4f5e-86de-52a97b2a17e7-etc-kubernetes\") pod \"multus-q82xs\" (UID: \"6ba0ffc7-9736-4f5e-86de-52a97b2a17e7\") " pod="openshift-multus/multus-q82xs" Jul 28 16:35:53.654624 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.653824 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6ba0ffc7-9736-4f5e-86de-52a97b2a17e7-system-cni-dir\") pod \"multus-q82xs\" (UID: \"6ba0ffc7-9736-4f5e-86de-52a97b2a17e7\") " pod="openshift-multus/multus-q82xs" Jul 28 16:35:53.654624 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.653895 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/90ae3dbc-89ae-4464-b7db-3152c533ee19-etc-tuned\") pod \"tuned-kwxqv\" (UID: \"90ae3dbc-89ae-4464-b7db-3152c533ee19\") " pod="openshift-cluster-node-tuning-operator/tuned-kwxqv" Jul 28 16:35:53.654624 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.653943 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6ba0ffc7-9736-4f5e-86de-52a97b2a17e7-hostroot\") pod \"multus-q82xs\" (UID: \"6ba0ffc7-9736-4f5e-86de-52a97b2a17e7\") " pod="openshift-multus/multus-q82xs" Jul 28 16:35:53.654624 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.653947 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/021148b1-76cd-486f-a99d-e45527a9323e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.654624 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.653980 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6ba0ffc7-9736-4f5e-86de-52a97b2a17e7-host-run-k8s-cni-cncf-io\") pod \"multus-q82xs\" (UID: \"6ba0ffc7-9736-4f5e-86de-52a97b2a17e7\") " pod="openshift-multus/multus-q82xs" Jul 28 16:35:53.654624 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.654005 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6ba0ffc7-9736-4f5e-86de-52a97b2a17e7-host-run-netns\") pod \"multus-q82xs\" (UID: \"6ba0ffc7-9736-4f5e-86de-52a97b2a17e7\") " pod="openshift-multus/multus-q82xs" Jul 28 16:35:53.654624 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.654005 2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 28 16:35:53.654624 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.654028 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ba0ffc7-9736-4f5e-86de-52a97b2a17e7-host-var-lib-kubelet\") pod \"multus-q82xs\" (UID: \"6ba0ffc7-9736-4f5e-86de-52a97b2a17e7\") " pod="openshift-multus/multus-q82xs" Jul 28 16:35:53.654624 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.654053 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c5a59f48-8e47-4505-97b6-01f136669bd8-registration-dir\") pod \"aws-ebs-csi-driver-node-tlxzt\" (UID: \"c5a59f48-8e47-4505-97b6-01f136669bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tlxzt" Jul 28 16:35:53.654624 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.654073 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c5a59f48-8e47-4505-97b6-01f136669bd8-sys-fs\") pod \"aws-ebs-csi-driver-node-tlxzt\" (UID: \"c5a59f48-8e47-4505-97b6-01f136669bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tlxzt" Jul 28 16:35:53.654624 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.654095 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/90ae3dbc-89ae-4464-b7db-3152c533ee19-run\") pod \"tuned-kwxqv\" (UID: \"90ae3dbc-89ae-4464-b7db-3152c533ee19\") " pod="openshift-cluster-node-tuning-operator/tuned-kwxqv" Jul 28 16:35:53.654624 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.654106 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/021148b1-76cd-486f-a99d-e45527a9323e-ovnkube-config\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.654624 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.654114 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/90ae3dbc-89ae-4464-b7db-3152c533ee19-host\") pod \"tuned-kwxqv\" (UID: \"90ae3dbc-89ae-4464-b7db-3152c533ee19\") " pod="openshift-cluster-node-tuning-operator/tuned-kwxqv" Jul 28 16:35:53.655455 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.654137 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/021148b1-76cd-486f-a99d-e45527a9323e-host-run-ovn-kubernetes\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.655455 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.654147 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/021148b1-76cd-486f-a99d-e45527a9323e-etc-openvswitch\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.655455 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.654161 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/eb488c90-4340-45eb-bb7b-003ef9ca81d1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4zxv6\" (UID: \"eb488c90-4340-45eb-bb7b-003ef9ca81d1\") " pod="openshift-multus/multus-additional-cni-plugins-4zxv6" Jul 28 16:35:53.655455 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.654184 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eb488c90-4340-45eb-bb7b-003ef9ca81d1-os-release\") pod \"multus-additional-cni-plugins-4zxv6\" (UID: \"eb488c90-4340-45eb-bb7b-003ef9ca81d1\") " pod="openshift-multus/multus-additional-cni-plugins-4zxv6" Jul 28 16:35:53.655455 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.654192 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ba0ffc7-9736-4f5e-86de-52a97b2a17e7-host-var-lib-kubelet\") pod \"multus-q82xs\" (UID: \"6ba0ffc7-9736-4f5e-86de-52a97b2a17e7\") " pod="openshift-multus/multus-q82xs" Jul 28 16:35:53.655455 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.654204 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6ba0ffc7-9736-4f5e-86de-52a97b2a17e7-multus-cni-dir\") pod \"multus-q82xs\" (UID: \"6ba0ffc7-9736-4f5e-86de-52a97b2a17e7\") " pod="openshift-multus/multus-q82xs" Jul 28 16:35:53.655455 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.654216 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/021148b1-76cd-486f-a99d-e45527a9323e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.655455 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.654225 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6ba0ffc7-9736-4f5e-86de-52a97b2a17e7-host-var-lib-cni-bin\") pod \"multus-q82xs\" (UID: \"6ba0ffc7-9736-4f5e-86de-52a97b2a17e7\") " pod="openshift-multus/multus-q82xs" Jul 28 16:35:53.655455 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.653909 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90ae3dbc-89ae-4464-b7db-3152c533ee19-var-lib-kubelet\") pod \"tuned-kwxqv\" (UID: \"90ae3dbc-89ae-4464-b7db-3152c533ee19\") " pod="openshift-cluster-node-tuning-operator/tuned-kwxqv" Jul 28 16:35:53.655455 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.654228 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6ba0ffc7-9736-4f5e-86de-52a97b2a17e7-host-run-k8s-cni-cncf-io\") pod \"multus-q82xs\" (UID: \"6ba0ffc7-9736-4f5e-86de-52a97b2a17e7\") " pod="openshift-multus/multus-q82xs" Jul 28 16:35:53.655455 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.654272 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6ba0ffc7-9736-4f5e-86de-52a97b2a17e7-host-run-netns\") pod \"multus-q82xs\" (UID: \"6ba0ffc7-9736-4f5e-86de-52a97b2a17e7\") " pod="openshift-multus/multus-q82xs" Jul 28 16:35:53.655455 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.654293 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/021148b1-76cd-486f-a99d-e45527a9323e-host-run-ovn-kubernetes\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.655455 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.654308 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2613b1fa-f3a0-4a1b-a90c-029c1a1dae6d-serviceca\") pod \"node-ca-4899s\" (UID: \"2613b1fa-f3a0-4a1b-a90c-029c1a1dae6d\") " pod="openshift-image-registry/node-ca-4899s" Jul 28 16:35:53.655455 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.654338 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f0f2ba44-e234-4d76-9d0d-a152fd55e253-hosts-file\") pod \"node-resolver-xr8r8\" (UID: \"f0f2ba44-e234-4d76-9d0d-a152fd55e253\") " pod="openshift-dns/node-resolver-xr8r8" Jul 28 16:35:53.655455 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.654345 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/90ae3dbc-89ae-4464-b7db-3152c533ee19-host\") pod \"tuned-kwxqv\" (UID: \"90ae3dbc-89ae-4464-b7db-3152c533ee19\") " pod="openshift-cluster-node-tuning-operator/tuned-kwxqv" Jul 28 16:35:53.655455 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.654361 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eb488c90-4340-45eb-bb7b-003ef9ca81d1-os-release\") pod \"multus-additional-cni-plugins-4zxv6\" (UID: \"eb488c90-4340-45eb-bb7b-003ef9ca81d1\") " pod="openshift-multus/multus-additional-cni-plugins-4zxv6" Jul 28 16:35:53.655455 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.654367 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6bf1d484-4b82-487c-bcf1-be189dabfd24-dbus\") pod \"global-pull-secret-syncer-fdgv8\" (UID: \"6bf1d484-4b82-487c-bcf1-be189dabfd24\") " pod="kube-system/global-pull-secret-syncer-fdgv8" Jul 28 16:35:53.656271 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.654440 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6ba0ffc7-9736-4f5e-86de-52a97b2a17e7-multus-cni-dir\") pod \"multus-q82xs\" (UID: \"6ba0ffc7-9736-4f5e-86de-52a97b2a17e7\") " pod="openshift-multus/multus-q82xs" Jul 28 16:35:53.656271 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.654536 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f0f2ba44-e234-4d76-9d0d-a152fd55e253-hosts-file\") pod \"node-resolver-xr8r8\" (UID: \"f0f2ba44-e234-4d76-9d0d-a152fd55e253\") " pod="openshift-dns/node-resolver-xr8r8" Jul 28 16:35:53.656271 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.654576 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6ba0ffc7-9736-4f5e-86de-52a97b2a17e7-host-var-lib-cni-bin\") pod \"multus-q82xs\" (UID: \"6ba0ffc7-9736-4f5e-86de-52a97b2a17e7\") " pod="openshift-multus/multus-q82xs" Jul 28 16:35:53.656271 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.654627 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/90ae3dbc-89ae-4464-b7db-3152c533ee19-etc-sysctl-d\") pod \"tuned-kwxqv\" (UID: \"90ae3dbc-89ae-4464-b7db-3152c533ee19\") " pod="openshift-cluster-node-tuning-operator/tuned-kwxqv" Jul 28 16:35:53.656271 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.654655 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/90ae3dbc-89ae-4464-b7db-3152c533ee19-sys\") pod \"tuned-kwxqv\" (UID: \"90ae3dbc-89ae-4464-b7db-3152c533ee19\") " pod="openshift-cluster-node-tuning-operator/tuned-kwxqv" Jul 28 16:35:53.656271 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.654691 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eb488c90-4340-45eb-bb7b-003ef9ca81d1-cni-binary-copy\") pod \"multus-additional-cni-plugins-4zxv6\" (UID: \"eb488c90-4340-45eb-bb7b-003ef9ca81d1\") " pod="openshift-multus/multus-additional-cni-plugins-4zxv6" Jul 28 16:35:53.656271 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.654719 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/021148b1-76cd-486f-a99d-e45527a9323e-host-slash\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.656271 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.654742 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/021148b1-76cd-486f-a99d-e45527a9323e-run-systemd\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.656271 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.654779 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/021148b1-76cd-486f-a99d-e45527a9323e-ovn-node-metrics-cert\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.656271 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.654797 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/021148b1-76cd-486f-a99d-e45527a9323e-env-overrides\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.656271 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.654845 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eb488c90-4340-45eb-bb7b-003ef9ca81d1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4zxv6\" (UID: \"eb488c90-4340-45eb-bb7b-003ef9ca81d1\") " pod="openshift-multus/multus-additional-cni-plugins-4zxv6" Jul 28 16:35:53.656271 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.654890 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/90ae3dbc-89ae-4464-b7db-3152c533ee19-run\") pod \"tuned-kwxqv\" (UID: \"90ae3dbc-89ae-4464-b7db-3152c533ee19\") " pod="openshift-cluster-node-tuning-operator/tuned-kwxqv" Jul 28 16:35:53.656271 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.654897 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rbh7\" (UniqueName: \"kubernetes.io/projected/eb488c90-4340-45eb-bb7b-003ef9ca81d1-kube-api-access-7rbh7\") pod \"multus-additional-cni-plugins-4zxv6\" (UID: \"eb488c90-4340-45eb-bb7b-003ef9ca81d1\") " pod="openshift-multus/multus-additional-cni-plugins-4zxv6" Jul 28 16:35:53.656271 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.654943 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/eb488c90-4340-45eb-bb7b-003ef9ca81d1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4zxv6\" (UID: \"eb488c90-4340-45eb-bb7b-003ef9ca81d1\") " pod="openshift-multus/multus-additional-cni-plugins-4zxv6" Jul 28 16:35:53.656271 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.655004 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/021148b1-76cd-486f-a99d-e45527a9323e-run-systemd\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.656271 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.655065 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/021148b1-76cd-486f-a99d-e45527a9323e-host-slash\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.656271 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.655126 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2613b1fa-f3a0-4a1b-a90c-029c1a1dae6d-serviceca\") pod \"node-ca-4899s\" (UID: \"2613b1fa-f3a0-4a1b-a90c-029c1a1dae6d\") " pod="openshift-image-registry/node-ca-4899s" Jul 28 16:35:53.656271 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.655153 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/90ae3dbc-89ae-4464-b7db-3152c533ee19-sys\") pod \"tuned-kwxqv\" (UID: \"90ae3dbc-89ae-4464-b7db-3152c533ee19\") " pod="openshift-cluster-node-tuning-operator/tuned-kwxqv" Jul 28 16:35:53.657073 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.655296 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6ba0ffc7-9736-4f5e-86de-52a97b2a17e7-cnibin\") pod \"multus-q82xs\" (UID: \"6ba0ffc7-9736-4f5e-86de-52a97b2a17e7\") " pod="openshift-multus/multus-q82xs" Jul 28 16:35:53.657073 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.655360 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6ba0ffc7-9736-4f5e-86de-52a97b2a17e7-os-release\") pod \"multus-q82xs\" (UID: \"6ba0ffc7-9736-4f5e-86de-52a97b2a17e7\") " pod="openshift-multus/multus-q82xs" Jul 28 16:35:53.657073 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.655343 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eb488c90-4340-45eb-bb7b-003ef9ca81d1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4zxv6\" (UID: \"eb488c90-4340-45eb-bb7b-003ef9ca81d1\") " pod="openshift-multus/multus-additional-cni-plugins-4zxv6" Jul 28 16:35:53.657073 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.655404 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6ba0ffc7-9736-4f5e-86de-52a97b2a17e7-cnibin\") pod \"multus-q82xs\" (UID: \"6ba0ffc7-9736-4f5e-86de-52a97b2a17e7\") " pod="openshift-multus/multus-q82xs" Jul 28 16:35:53.657073 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.655421 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/90ae3dbc-89ae-4464-b7db-3152c533ee19-etc-sysctl-d\") pod \"tuned-kwxqv\" (UID: \"90ae3dbc-89ae-4464-b7db-3152c533ee19\") " pod="openshift-cluster-node-tuning-operator/tuned-kwxqv" Jul 28 16:35:53.657073 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.655482 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6ba0ffc7-9736-4f5e-86de-52a97b2a17e7-os-release\") pod \"multus-q82xs\" (UID: \"6ba0ffc7-9736-4f5e-86de-52a97b2a17e7\") " pod="openshift-multus/multus-q82xs" Jul 28 16:35:53.657073 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.655514 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm78g\" (UniqueName: \"kubernetes.io/projected/3f9f655d-f123-4c01-ab93-61377299680a-kube-api-access-gm78g\") pod \"iptables-alerter-shk5x\" (UID: \"3f9f655d-f123-4c01-ab93-61377299680a\") " pod="openshift-network-operator/iptables-alerter-shk5x" Jul 28 16:35:53.657073 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.655544 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/90ae3dbc-89ae-4464-b7db-3152c533ee19-etc-modprobe-d\") pod \"tuned-kwxqv\" (UID: \"90ae3dbc-89ae-4464-b7db-3152c533ee19\") " pod="openshift-cluster-node-tuning-operator/tuned-kwxqv" Jul 28 16:35:53.657073 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.655569 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/021148b1-76cd-486f-a99d-e45527a9323e-run-openvswitch\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.657073 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.655630 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/021148b1-76cd-486f-a99d-e45527a9323e-node-log\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.657073 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.655633 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/90ae3dbc-89ae-4464-b7db-3152c533ee19-etc-modprobe-d\") pod \"tuned-kwxqv\" (UID: \"90ae3dbc-89ae-4464-b7db-3152c533ee19\") " pod="openshift-cluster-node-tuning-operator/tuned-kwxqv" Jul 28 16:35:53.657073 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.655687 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/021148b1-76cd-486f-a99d-e45527a9323e-node-log\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.657073 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.655691 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3f9f655d-f123-4c01-ab93-61377299680a-host-slash\") pod \"iptables-alerter-shk5x\" (UID: \"3f9f655d-f123-4c01-ab93-61377299680a\") " pod="openshift-network-operator/iptables-alerter-shk5x" Jul 28 16:35:53.657073 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.655738 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c5a59f48-8e47-4505-97b6-01f136669bd8-device-dir\") pod \"aws-ebs-csi-driver-node-tlxzt\" (UID: \"c5a59f48-8e47-4505-97b6-01f136669bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tlxzt" Jul 28 16:35:53.657073 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.655691 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/021148b1-76cd-486f-a99d-e45527a9323e-run-openvswitch\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.657073 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.655760 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c5a59f48-8e47-4505-97b6-01f136669bd8-etc-selinux\") pod \"aws-ebs-csi-driver-node-tlxzt\" (UID: \"c5a59f48-8e47-4505-97b6-01f136669bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tlxzt" Jul 28 16:35:53.657073 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.655801 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5pjt\" (UniqueName: \"kubernetes.io/projected/90ae3dbc-89ae-4464-b7db-3152c533ee19-kube-api-access-w5pjt\") pod \"tuned-kwxqv\" (UID: \"90ae3dbc-89ae-4464-b7db-3152c533ee19\") " pod="openshift-cluster-node-tuning-operator/tuned-kwxqv" Jul 28 16:35:53.657837 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.655842 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/021148b1-76cd-486f-a99d-e45527a9323e-host-kubelet\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.657837 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.655865 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/258401ce-b809-4fe8-8c76-f64168a32d6e-agent-certs\") pod \"konnectivity-agent-pwcjg\" (UID: \"258401ce-b809-4fe8-8c76-f64168a32d6e\") " pod="kube-system/konnectivity-agent-pwcjg" Jul 28 16:35:53.657837 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.655888 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/258401ce-b809-4fe8-8c76-f64168a32d6e-konnectivity-ca\") pod \"konnectivity-agent-pwcjg\" (UID: \"258401ce-b809-4fe8-8c76-f64168a32d6e\") " pod="kube-system/konnectivity-agent-pwcjg" Jul 28 16:35:53.657837 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.655911 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6ba0ffc7-9736-4f5e-86de-52a97b2a17e7-host-run-multus-certs\") pod \"multus-q82xs\" (UID: \"6ba0ffc7-9736-4f5e-86de-52a97b2a17e7\") " pod="openshift-multus/multus-q82xs" Jul 28 16:35:53.657837 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.655970 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/021148b1-76cd-486f-a99d-e45527a9323e-host-kubelet\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.657837 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.655984 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6bf1d484-4b82-487c-bcf1-be189dabfd24-original-pull-secret\") pod \"global-pull-secret-syncer-fdgv8\" (UID: \"6bf1d484-4b82-487c-bcf1-be189dabfd24\") " pod="kube-system/global-pull-secret-syncer-fdgv8" Jul 28 16:35:53.657837 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.656032 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3f9f655d-f123-4c01-ab93-61377299680a-iptables-alerter-script\") pod \"iptables-alerter-shk5x\" (UID: \"3f9f655d-f123-4c01-ab93-61377299680a\") " pod="openshift-network-operator/iptables-alerter-shk5x" Jul 28 16:35:53.657837 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.656077 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c5a59f48-8e47-4505-97b6-01f136669bd8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tlxzt\" (UID: \"c5a59f48-8e47-4505-97b6-01f136669bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tlxzt" Jul 28 16:35:53.657837 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.656103 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/90ae3dbc-89ae-4464-b7db-3152c533ee19-etc-systemd\") pod \"tuned-kwxqv\" (UID: \"90ae3dbc-89ae-4464-b7db-3152c533ee19\") " pod="openshift-cluster-node-tuning-operator/tuned-kwxqv" Jul 28 16:35:53.657837 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.656181 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6ba0ffc7-9736-4f5e-86de-52a97b2a17e7-host-run-multus-certs\") pod \"multus-q82xs\" (UID: \"6ba0ffc7-9736-4f5e-86de-52a97b2a17e7\") " pod="openshift-multus/multus-q82xs" Jul 28 16:35:53.657837 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.656183 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/021148b1-76cd-486f-a99d-e45527a9323e-host-run-netns\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.657837 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.656250 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/021148b1-76cd-486f-a99d-e45527a9323e-host-run-netns\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.657837 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.656269 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/021148b1-76cd-486f-a99d-e45527a9323e-host-cni-netd\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.657837 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.656311 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6ba0ffc7-9736-4f5e-86de-52a97b2a17e7-host-var-lib-cni-multus\") pod \"multus-q82xs\" (UID: \"6ba0ffc7-9736-4f5e-86de-52a97b2a17e7\") " pod="openshift-multus/multus-q82xs" Jul 28 16:35:53.657837 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.656353 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/021148b1-76cd-486f-a99d-e45527a9323e-host-cni-netd\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.657837 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.656382 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/90ae3dbc-89ae-4464-b7db-3152c533ee19-etc-systemd\") pod \"tuned-kwxqv\" (UID: \"90ae3dbc-89ae-4464-b7db-3152c533ee19\") " pod="openshift-cluster-node-tuning-operator/tuned-kwxqv" Jul 28 16:35:53.657837 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.656424 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0f2ba44-e234-4d76-9d0d-a152fd55e253-tmp-dir\") pod \"node-resolver-xr8r8\" (UID: \"f0f2ba44-e234-4d76-9d0d-a152fd55e253\") " pod="openshift-dns/node-resolver-xr8r8" Jul 28 16:35:53.658495 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.656429 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6ba0ffc7-9736-4f5e-86de-52a97b2a17e7-host-var-lib-cni-multus\") pod \"multus-q82xs\" (UID: \"6ba0ffc7-9736-4f5e-86de-52a97b2a17e7\") " pod="openshift-multus/multus-q82xs" Jul 28 16:35:53.658495 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.656552 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/258401ce-b809-4fe8-8c76-f64168a32d6e-konnectivity-ca\") pod \"konnectivity-agent-pwcjg\" (UID: \"258401ce-b809-4fe8-8c76-f64168a32d6e\") " pod="kube-system/konnectivity-agent-pwcjg" Jul 28 16:35:53.658495 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.656767 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eb488c90-4340-45eb-bb7b-003ef9ca81d1-cni-binary-copy\") pod \"multus-additional-cni-plugins-4zxv6\" (UID: \"eb488c90-4340-45eb-bb7b-003ef9ca81d1\") " pod="openshift-multus/multus-additional-cni-plugins-4zxv6" Jul 28 16:35:53.658495 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.657226 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0f2ba44-e234-4d76-9d0d-a152fd55e253-tmp-dir\") pod \"node-resolver-xr8r8\" (UID: \"f0f2ba44-e234-4d76-9d0d-a152fd55e253\") " pod="openshift-dns/node-resolver-xr8r8" Jul 28 16:35:53.658495 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.657996 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/90ae3dbc-89ae-4464-b7db-3152c533ee19-etc-tuned\") pod \"tuned-kwxqv\" (UID: \"90ae3dbc-89ae-4464-b7db-3152c533ee19\") " pod="openshift-cluster-node-tuning-operator/tuned-kwxqv" Jul 28 16:35:53.658495 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.658224 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/021148b1-76cd-486f-a99d-e45527a9323e-ovn-node-metrics-cert\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.658495 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.658320 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90ae3dbc-89ae-4464-b7db-3152c533ee19-tmp\") pod \"tuned-kwxqv\" (UID: \"90ae3dbc-89ae-4464-b7db-3152c533ee19\") " pod="openshift-cluster-node-tuning-operator/tuned-kwxqv" Jul 28 16:35:53.659032 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.658985 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/258401ce-b809-4fe8-8c76-f64168a32d6e-agent-certs\") pod \"konnectivity-agent-pwcjg\" (UID: \"258401ce-b809-4fe8-8c76-f64168a32d6e\") " pod="kube-system/konnectivity-agent-pwcjg" Jul 28 16:35:53.661166 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.661074 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8lxk\" (UniqueName: \"kubernetes.io/projected/2613b1fa-f3a0-4a1b-a90c-029c1a1dae6d-kube-api-access-k8lxk\") pod \"node-ca-4899s\" (UID: \"2613b1fa-f3a0-4a1b-a90c-029c1a1dae6d\") " pod="openshift-image-registry/node-ca-4899s" Jul 28 16:35:53.662981 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.662923 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdml7\" (UniqueName: \"kubernetes.io/projected/021148b1-76cd-486f-a99d-e45527a9323e-kube-api-access-gdml7\") pod \"ovnkube-node-vjvs7\" (UID: \"021148b1-76cd-486f-a99d-e45527a9323e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.665795 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.665770 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5pjt\" (UniqueName: \"kubernetes.io/projected/90ae3dbc-89ae-4464-b7db-3152c533ee19-kube-api-access-w5pjt\") pod \"tuned-kwxqv\" (UID: \"90ae3dbc-89ae-4464-b7db-3152c533ee19\") " pod="openshift-cluster-node-tuning-operator/tuned-kwxqv" Jul 28 16:35:53.666588 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.666519 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmfws\" (UniqueName: \"kubernetes.io/projected/6ba0ffc7-9736-4f5e-86de-52a97b2a17e7-kube-api-access-hmfws\") pod \"multus-q82xs\" (UID: \"6ba0ffc7-9736-4f5e-86de-52a97b2a17e7\") " pod="openshift-multus/multus-q82xs" Jul 28 16:35:53.667640 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.667598 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rbh7\" (UniqueName: \"kubernetes.io/projected/eb488c90-4340-45eb-bb7b-003ef9ca81d1-kube-api-access-7rbh7\") pod \"multus-additional-cni-plugins-4zxv6\" (UID: \"eb488c90-4340-45eb-bb7b-003ef9ca81d1\") " pod="openshift-multus/multus-additional-cni-plugins-4zxv6" Jul 28 16:35:53.668048 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.668023 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bnph\" (UniqueName: \"kubernetes.io/projected/f0f2ba44-e234-4d76-9d0d-a152fd55e253-kube-api-access-4bnph\") pod \"node-resolver-xr8r8\" (UID: \"f0f2ba44-e234-4d76-9d0d-a152fd55e253\") " pod="openshift-dns/node-resolver-xr8r8" Jul 28 16:35:53.727368 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.727315 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-245.ec2.internal" event={"ID":"0e448a3525fc7835a6d30329884309d8","Type":"ContainerStarted","Data":"f7617cc7b2250363ecc077ec8b447c0fcdc2f2b750842875f9e6ee039a576f72"} Jul 28 16:35:53.728390 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.728364 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-245.ec2.internal" event={"ID":"538e10424abd3b03414a01fd5ea53009","Type":"ContainerStarted","Data":"45923cb8f27ea181d756f4ee11d30aceba70d71626b2c06128d79f3c5f0a5667"} Jul 28 16:35:53.757253 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.757215 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhhcw\" (UniqueName: \"kubernetes.io/projected/da54b8f0-8ec1-4b28-a76b-037edb5bec20-kube-api-access-rhhcw\") pod \"network-metrics-daemon-q6dz7\" (UID: \"da54b8f0-8ec1-4b28-a76b-037edb5bec20\") " pod="openshift-multus/network-metrics-daemon-q6dz7" Jul 28 16:35:53.757391 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.757262 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c5a59f48-8e47-4505-97b6-01f136669bd8-registration-dir\") pod \"aws-ebs-csi-driver-node-tlxzt\" (UID: \"c5a59f48-8e47-4505-97b6-01f136669bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tlxzt" Jul 28 16:35:53.757391 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.757282 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c5a59f48-8e47-4505-97b6-01f136669bd8-sys-fs\") pod \"aws-ebs-csi-driver-node-tlxzt\" (UID: \"c5a59f48-8e47-4505-97b6-01f136669bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tlxzt" Jul 28 16:35:53.757391 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.757311 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6bf1d484-4b82-487c-bcf1-be189dabfd24-dbus\") pod \"global-pull-secret-syncer-fdgv8\" (UID: \"6bf1d484-4b82-487c-bcf1-be189dabfd24\") " pod="kube-system/global-pull-secret-syncer-fdgv8" Jul 28 16:35:53.757391 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.757340 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gm78g\" (UniqueName: \"kubernetes.io/projected/3f9f655d-f123-4c01-ab93-61377299680a-kube-api-access-gm78g\") pod \"iptables-alerter-shk5x\" (UID: \"3f9f655d-f123-4c01-ab93-61377299680a\") " pod="openshift-network-operator/iptables-alerter-shk5x" Jul 28 16:35:53.757391 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.757360 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c5a59f48-8e47-4505-97b6-01f136669bd8-registration-dir\") pod \"aws-ebs-csi-driver-node-tlxzt\" (UID: \"c5a59f48-8e47-4505-97b6-01f136669bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tlxzt" Jul 28 16:35:53.757644 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.757386 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c5a59f48-8e47-4505-97b6-01f136669bd8-sys-fs\") pod \"aws-ebs-csi-driver-node-tlxzt\" (UID: \"c5a59f48-8e47-4505-97b6-01f136669bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tlxzt" Jul 28 16:35:53.757644 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.757368 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3f9f655d-f123-4c01-ab93-61377299680a-host-slash\") pod \"iptables-alerter-shk5x\" (UID: \"3f9f655d-f123-4c01-ab93-61377299680a\") " pod="openshift-network-operator/iptables-alerter-shk5x" Jul 28 16:35:53.757644 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.757412 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3f9f655d-f123-4c01-ab93-61377299680a-host-slash\") pod \"iptables-alerter-shk5x\" (UID: \"3f9f655d-f123-4c01-ab93-61377299680a\") " pod="openshift-network-operator/iptables-alerter-shk5x" Jul 28 16:35:53.757644 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.757445 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c5a59f48-8e47-4505-97b6-01f136669bd8-device-dir\") pod \"aws-ebs-csi-driver-node-tlxzt\" (UID: \"c5a59f48-8e47-4505-97b6-01f136669bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tlxzt" Jul 28 16:35:53.757644 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.757469 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c5a59f48-8e47-4505-97b6-01f136669bd8-etc-selinux\") pod \"aws-ebs-csi-driver-node-tlxzt\" (UID: \"c5a59f48-8e47-4505-97b6-01f136669bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tlxzt" Jul 28 16:35:53.757644 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.757492 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6bf1d484-4b82-487c-bcf1-be189dabfd24-original-pull-secret\") pod \"global-pull-secret-syncer-fdgv8\" (UID: \"6bf1d484-4b82-487c-bcf1-be189dabfd24\") " pod="kube-system/global-pull-secret-syncer-fdgv8" Jul 28 16:35:53.757644 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.757490 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6bf1d484-4b82-487c-bcf1-be189dabfd24-dbus\") pod \"global-pull-secret-syncer-fdgv8\" (UID: \"6bf1d484-4b82-487c-bcf1-be189dabfd24\") " pod="kube-system/global-pull-secret-syncer-fdgv8" Jul 28 16:35:53.757644 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.757512 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3f9f655d-f123-4c01-ab93-61377299680a-iptables-alerter-script\") pod \"iptables-alerter-shk5x\" (UID: \"3f9f655d-f123-4c01-ab93-61377299680a\") " pod="openshift-network-operator/iptables-alerter-shk5x" Jul 28 16:35:53.757644 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.757510 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c5a59f48-8e47-4505-97b6-01f136669bd8-device-dir\") pod \"aws-ebs-csi-driver-node-tlxzt\" (UID: \"c5a59f48-8e47-4505-97b6-01f136669bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tlxzt" Jul 28 16:35:53.757644 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.757597 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c5a59f48-8e47-4505-97b6-01f136669bd8-etc-selinux\") pod \"aws-ebs-csi-driver-node-tlxzt\" (UID: \"c5a59f48-8e47-4505-97b6-01f136669bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tlxzt" Jul 28 16:35:53.757644 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:53.757631 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 16:35:53.758149 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.757643 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c5a59f48-8e47-4505-97b6-01f136669bd8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tlxzt\" (UID: \"c5a59f48-8e47-4505-97b6-01f136669bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tlxzt" Jul 28 16:35:53.758149 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:53.757698 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bf1d484-4b82-487c-bcf1-be189dabfd24-original-pull-secret podName:6bf1d484-4b82-487c-bcf1-be189dabfd24 nodeName:}" failed. No retries permitted until 2026-07-28 16:35:54.257676719 +0000 UTC m=+3.051472993 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6bf1d484-4b82-487c-bcf1-be189dabfd24-original-pull-secret") pod "global-pull-secret-syncer-fdgv8" (UID: "6bf1d484-4b82-487c-bcf1-be189dabfd24") : object "kube-system"/"original-pull-secret" not registered Jul 28 16:35:53.758149 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.757711 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bjjr\" (UniqueName: \"kubernetes.io/projected/c5a59f48-8e47-4505-97b6-01f136669bd8-kube-api-access-7bjjr\") pod \"aws-ebs-csi-driver-node-tlxzt\" (UID: \"c5a59f48-8e47-4505-97b6-01f136669bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tlxzt" Jul 28 16:35:53.758149 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.757708 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c5a59f48-8e47-4505-97b6-01f136669bd8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tlxzt\" (UID: \"c5a59f48-8e47-4505-97b6-01f136669bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tlxzt" Jul 28 16:35:53.758149 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.757743 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da54b8f0-8ec1-4b28-a76b-037edb5bec20-metrics-certs\") pod \"network-metrics-daemon-q6dz7\" (UID: \"da54b8f0-8ec1-4b28-a76b-037edb5bec20\") " pod="openshift-multus/network-metrics-daemon-q6dz7" Jul 28 16:35:53.758149 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.757769 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6bf1d484-4b82-487c-bcf1-be189dabfd24-kubelet-config\") pod \"global-pull-secret-syncer-fdgv8\" (UID: \"6bf1d484-4b82-487c-bcf1-be189dabfd24\") " pod="kube-system/global-pull-secret-syncer-fdgv8" Jul 28 16:35:53.758149 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.757792 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c5a59f48-8e47-4505-97b6-01f136669bd8-socket-dir\") pod \"aws-ebs-csi-driver-node-tlxzt\" (UID: \"c5a59f48-8e47-4505-97b6-01f136669bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tlxzt" Jul 28 16:35:53.758149 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.757813 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xftt8\" (UniqueName: \"kubernetes.io/projected/45e07f9b-6993-4b7d-bf17-197b21c25a4b-kube-api-access-xftt8\") pod \"network-check-target-wq5zz\" (UID: \"45e07f9b-6993-4b7d-bf17-197b21c25a4b\") " pod="openshift-network-diagnostics/network-check-target-wq5zz" Jul 28 16:35:53.758149 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.757859 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6bf1d484-4b82-487c-bcf1-be189dabfd24-kubelet-config\") pod \"global-pull-secret-syncer-fdgv8\" (UID: \"6bf1d484-4b82-487c-bcf1-be189dabfd24\") " pod="kube-system/global-pull-secret-syncer-fdgv8" Jul 28 16:35:53.758149 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:53.757938 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 16:35:53.758149 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.757959 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c5a59f48-8e47-4505-97b6-01f136669bd8-socket-dir\") pod \"aws-ebs-csi-driver-node-tlxzt\" (UID: \"c5a59f48-8e47-4505-97b6-01f136669bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tlxzt" Jul 28 16:35:53.758149 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:53.757985 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da54b8f0-8ec1-4b28-a76b-037edb5bec20-metrics-certs podName:da54b8f0-8ec1-4b28-a76b-037edb5bec20 nodeName:}" failed. No retries permitted until 2026-07-28 16:35:54.257967796 +0000 UTC m=+3.051764050 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/da54b8f0-8ec1-4b28-a76b-037edb5bec20-metrics-certs") pod "network-metrics-daemon-q6dz7" (UID: "da54b8f0-8ec1-4b28-a76b-037edb5bec20") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 16:35:53.758149 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.758118 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3f9f655d-f123-4c01-ab93-61377299680a-iptables-alerter-script\") pod \"iptables-alerter-shk5x\" (UID: \"3f9f655d-f123-4c01-ab93-61377299680a\") " pod="openshift-network-operator/iptables-alerter-shk5x" Jul 28 16:35:53.764303 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:53.764281 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 16:35:53.764406 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:53.764328 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 16:35:53.764406 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:53.764342 2563 projected.go:196] Error preparing data for projected volume kube-api-access-xftt8 for pod openshift-network-diagnostics/network-check-target-wq5zz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 16:35:53.764406 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:53.764400 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45e07f9b-6993-4b7d-bf17-197b21c25a4b-kube-api-access-xftt8 podName:45e07f9b-6993-4b7d-bf17-197b21c25a4b nodeName:}" failed. No retries permitted until 2026-07-28 16:35:54.264384399 +0000 UTC m=+3.058180674 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xftt8" (UniqueName: "kubernetes.io/projected/45e07f9b-6993-4b7d-bf17-197b21c25a4b-kube-api-access-xftt8") pod "network-check-target-wq5zz" (UID: "45e07f9b-6993-4b7d-bf17-197b21c25a4b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 16:35:53.767083 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.767062 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm78g\" (UniqueName: \"kubernetes.io/projected/3f9f655d-f123-4c01-ab93-61377299680a-kube-api-access-gm78g\") pod \"iptables-alerter-shk5x\" (UID: \"3f9f655d-f123-4c01-ab93-61377299680a\") " pod="openshift-network-operator/iptables-alerter-shk5x" Jul 28 16:35:53.767181 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.767062 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhhcw\" (UniqueName: \"kubernetes.io/projected/da54b8f0-8ec1-4b28-a76b-037edb5bec20-kube-api-access-rhhcw\") pod \"network-metrics-daemon-q6dz7\" (UID: \"da54b8f0-8ec1-4b28-a76b-037edb5bec20\") " pod="openshift-multus/network-metrics-daemon-q6dz7" Jul 28 16:35:53.767181 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.767143 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bjjr\" (UniqueName: \"kubernetes.io/projected/c5a59f48-8e47-4505-97b6-01f136669bd8-kube-api-access-7bjjr\") pod \"aws-ebs-csi-driver-node-tlxzt\" (UID: \"c5a59f48-8e47-4505-97b6-01f136669bd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tlxzt" Jul 28 16:35:53.844975 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.844904 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q82xs" Jul 28 16:35:53.850096 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.850078 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 16:35:53.852208 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.852187 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4899s" Jul 28 16:35:53.862015 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.861989 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kwxqv" Jul 28 16:35:53.867693 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.867678 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xr8r8" Jul 28 16:35:53.875506 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.875487 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:35:53.883490 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.883471 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4zxv6" Jul 28 16:35:53.890265 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.890247 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pwcjg" Jul 28 16:35:53.897048 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.897029 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-shk5x" Jul 28 16:35:53.902246 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:53.902227 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tlxzt" Jul 28 16:35:54.261677 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:54.261586 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da54b8f0-8ec1-4b28-a76b-037edb5bec20-metrics-certs\") pod \"network-metrics-daemon-q6dz7\" (UID: \"da54b8f0-8ec1-4b28-a76b-037edb5bec20\") " pod="openshift-multus/network-metrics-daemon-q6dz7" Jul 28 16:35:54.261825 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:54.261690 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6bf1d484-4b82-487c-bcf1-be189dabfd24-original-pull-secret\") pod \"global-pull-secret-syncer-fdgv8\" (UID: \"6bf1d484-4b82-487c-bcf1-be189dabfd24\") " pod="kube-system/global-pull-secret-syncer-fdgv8" Jul 28 16:35:54.261825 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:54.261723 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 16:35:54.261825 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:54.261793 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 16:35:54.261825 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:54.261802 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da54b8f0-8ec1-4b28-a76b-037edb5bec20-metrics-certs podName:da54b8f0-8ec1-4b28-a76b-037edb5bec20 nodeName:}" failed. No retries permitted until 2026-07-28 16:35:55.261782448 +0000 UTC m=+4.055578729 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/da54b8f0-8ec1-4b28-a76b-037edb5bec20-metrics-certs") pod "network-metrics-daemon-q6dz7" (UID: "da54b8f0-8ec1-4b28-a76b-037edb5bec20") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 16:35:54.262024 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:54.261843 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bf1d484-4b82-487c-bcf1-be189dabfd24-original-pull-secret podName:6bf1d484-4b82-487c-bcf1-be189dabfd24 nodeName:}" failed. No retries permitted until 2026-07-28 16:35:55.261827153 +0000 UTC m=+4.055623413 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6bf1d484-4b82-487c-bcf1-be189dabfd24-original-pull-secret") pod "global-pull-secret-syncer-fdgv8" (UID: "6bf1d484-4b82-487c-bcf1-be189dabfd24") : object "kube-system"/"original-pull-secret" not registered Jul 28 16:35:54.362482 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:54.362441 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xftt8\" (UniqueName: \"kubernetes.io/projected/45e07f9b-6993-4b7d-bf17-197b21c25a4b-kube-api-access-xftt8\") pod \"network-check-target-wq5zz\" (UID: \"45e07f9b-6993-4b7d-bf17-197b21c25a4b\") " pod="openshift-network-diagnostics/network-check-target-wq5zz" Jul 28 16:35:54.362682 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:54.362599 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 16:35:54.362682 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:54.362637 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 16:35:54.362682 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:54.362652 2563 projected.go:196] Error preparing data for projected volume kube-api-access-xftt8 for pod openshift-network-diagnostics/network-check-target-wq5zz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 16:35:54.362828 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:54.362707 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45e07f9b-6993-4b7d-bf17-197b21c25a4b-kube-api-access-xftt8 podName:45e07f9b-6993-4b7d-bf17-197b21c25a4b nodeName:}" failed. No retries permitted until 2026-07-28 16:35:55.362691329 +0000 UTC m=+4.156487586 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xftt8" (UniqueName: "kubernetes.io/projected/45e07f9b-6993-4b7d-bf17-197b21c25a4b-kube-api-access-xftt8") pod "network-check-target-wq5zz" (UID: "45e07f9b-6993-4b7d-bf17-197b21c25a4b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 16:35:54.537534 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:54.537495 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0f2ba44_e234_4d76_9d0d_a152fd55e253.slice/crio-78ca342e329d954c787dac6b19bc648af3ed103fea27ecdfd05f7006ac5c5cf6 WatchSource:0}: Error finding container 78ca342e329d954c787dac6b19bc648af3ed103fea27ecdfd05f7006ac5c5cf6: Status 404 returned error can't find the container with id 78ca342e329d954c787dac6b19bc648af3ed103fea27ecdfd05f7006ac5c5cf6 Jul 28 16:35:54.540164 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:54.540125 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb488c90_4340_45eb_bb7b_003ef9ca81d1.slice/crio-fe8b29e2896b54b3c66a3cfa344ff42c751f3ce938f51b55d6fabba89118f778 WatchSource:0}: Error finding container fe8b29e2896b54b3c66a3cfa344ff42c751f3ce938f51b55d6fabba89118f778: Status 404 returned error can't find the container with id fe8b29e2896b54b3c66a3cfa344ff42c751f3ce938f51b55d6fabba89118f778 Jul 28 16:35:54.542021 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:54.542001 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f9f655d_f123_4c01_ab93_61377299680a.slice/crio-09c81566ce94011d135d1e44edccfc46a60f14d3b345357d2d0d10dd58551eda WatchSource:0}: Error finding container 09c81566ce94011d135d1e44edccfc46a60f14d3b345357d2d0d10dd58551eda: Status 404 returned error can't find the container with id 09c81566ce94011d135d1e44edccfc46a60f14d3b345357d2d0d10dd58551eda Jul 28 16:35:54.543634 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:54.543597 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90ae3dbc_89ae_4464_b7db_3152c533ee19.slice/crio-394b44ada69d6e617d3ea957a17811a554447ce0170dd772164c0c0dd95d240f WatchSource:0}: Error finding container 394b44ada69d6e617d3ea957a17811a554447ce0170dd772164c0c0dd95d240f: Status 404 returned error can't find the container with id 394b44ada69d6e617d3ea957a17811a554447ce0170dd772164c0c0dd95d240f Jul 28 16:35:54.545420 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:54.545237 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod021148b1_76cd_486f_a99d_e45527a9323e.slice/crio-3bc40ed31d5ef3e1289e338e3e5bb452205c8cb3e2b5fa5cce61ffbef4271e05 WatchSource:0}: Error finding container 3bc40ed31d5ef3e1289e338e3e5bb452205c8cb3e2b5fa5cce61ffbef4271e05: Status 404 returned error can't find the container with id 3bc40ed31d5ef3e1289e338e3e5bb452205c8cb3e2b5fa5cce61ffbef4271e05 Jul 28 16:35:54.546166 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:35:54.546075 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ba0ffc7_9736_4f5e_86de_52a97b2a17e7.slice/crio-882e4c87a7fe6d81919e733822c2ff88a73f54a249e622cf690f10bacd326fe7 WatchSource:0}: Error finding container 882e4c87a7fe6d81919e733822c2ff88a73f54a249e622cf690f10bacd326fe7: Status 404 returned error can't find the container with id 882e4c87a7fe6d81919e733822c2ff88a73f54a249e622cf690f10bacd326fe7 Jul 28 16:35:54.582025 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:54.581998 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 16:30:53 +0000 UTC" deadline="2028-02-13 00:33:13.725336901 +0000 UTC" Jul 28 16:35:54.582025 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:54.582022 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13543h57m19.143317746s" Jul 28 16:35:54.723336 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:54.723184 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wq5zz" Jul 28 16:35:54.723440 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:54.723413 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wq5zz" podUID="45e07f9b-6993-4b7d-bf17-197b21c25a4b" Jul 28 16:35:54.731092 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:54.731062 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" event={"ID":"021148b1-76cd-486f-a99d-e45527a9323e","Type":"ContainerStarted","Data":"3bc40ed31d5ef3e1289e338e3e5bb452205c8cb3e2b5fa5cce61ffbef4271e05"} Jul 28 16:35:54.732149 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:54.732124 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4zxv6" event={"ID":"eb488c90-4340-45eb-bb7b-003ef9ca81d1","Type":"ContainerStarted","Data":"fe8b29e2896b54b3c66a3cfa344ff42c751f3ce938f51b55d6fabba89118f778"} Jul 28 16:35:54.733005 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:54.732983 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xr8r8" event={"ID":"f0f2ba44-e234-4d76-9d0d-a152fd55e253","Type":"ContainerStarted","Data":"78ca342e329d954c787dac6b19bc648af3ed103fea27ecdfd05f7006ac5c5cf6"} Jul 28 16:35:54.734012 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:54.733989 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q82xs" event={"ID":"6ba0ffc7-9736-4f5e-86de-52a97b2a17e7","Type":"ContainerStarted","Data":"882e4c87a7fe6d81919e733822c2ff88a73f54a249e622cf690f10bacd326fe7"} Jul 28 16:35:54.735033 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:54.735005 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kwxqv" event={"ID":"90ae3dbc-89ae-4464-b7db-3152c533ee19","Type":"ContainerStarted","Data":"394b44ada69d6e617d3ea957a17811a554447ce0170dd772164c0c0dd95d240f"} Jul 28 16:35:54.736127 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:54.736106 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-shk5x" event={"ID":"3f9f655d-f123-4c01-ab93-61377299680a","Type":"ContainerStarted","Data":"09c81566ce94011d135d1e44edccfc46a60f14d3b345357d2d0d10dd58551eda"} Jul 28 16:35:54.737791 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:54.737769 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-245.ec2.internal" event={"ID":"538e10424abd3b03414a01fd5ea53009","Type":"ContainerStarted","Data":"66e52c326a1d400b1256d0679aee22ac033fc828e84176dc10671755cf15b1ab"} Jul 28 16:35:54.738783 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:54.738765 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4899s" event={"ID":"2613b1fa-f3a0-4a1b-a90c-029c1a1dae6d","Type":"ContainerStarted","Data":"00385e05fa32a74be1d361780110c52ebccd6224e1860ca83c4af9ce26592657"} Jul 28 16:35:54.739728 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:54.739705 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pwcjg" event={"ID":"258401ce-b809-4fe8-8c76-f64168a32d6e","Type":"ContainerStarted","Data":"68feb73276c4b650dc4aa856f27b50a7d0e14543e6361f40120859c5cc86bdc0"} Jul 28 16:35:54.740657 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:54.740638 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tlxzt" event={"ID":"c5a59f48-8e47-4505-97b6-01f136669bd8","Type":"ContainerStarted","Data":"62940a6cb13c931a2cb4f331cc80a92ed66236eacbef598ab7160fd31db68e07"} Jul 28 16:35:55.269244 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:55.269159 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6bf1d484-4b82-487c-bcf1-be189dabfd24-original-pull-secret\") pod \"global-pull-secret-syncer-fdgv8\" (UID: \"6bf1d484-4b82-487c-bcf1-be189dabfd24\") " pod="kube-system/global-pull-secret-syncer-fdgv8" Jul 28 16:35:55.269244 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:55.269229 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da54b8f0-8ec1-4b28-a76b-037edb5bec20-metrics-certs\") pod \"network-metrics-daemon-q6dz7\" (UID: \"da54b8f0-8ec1-4b28-a76b-037edb5bec20\") " pod="openshift-multus/network-metrics-daemon-q6dz7" Jul 28 16:35:55.269458 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:55.269364 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 16:35:55.269458 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:55.269397 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 16:35:55.269458 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:55.269425 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da54b8f0-8ec1-4b28-a76b-037edb5bec20-metrics-certs podName:da54b8f0-8ec1-4b28-a76b-037edb5bec20 nodeName:}" failed. No retries permitted until 2026-07-28 16:35:57.269406203 +0000 UTC m=+6.063202485 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/da54b8f0-8ec1-4b28-a76b-037edb5bec20-metrics-certs") pod "network-metrics-daemon-q6dz7" (UID: "da54b8f0-8ec1-4b28-a76b-037edb5bec20") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 16:35:55.269634 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:55.269505 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bf1d484-4b82-487c-bcf1-be189dabfd24-original-pull-secret podName:6bf1d484-4b82-487c-bcf1-be189dabfd24 nodeName:}" failed. No retries permitted until 2026-07-28 16:35:57.26944712 +0000 UTC m=+6.063243376 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6bf1d484-4b82-487c-bcf1-be189dabfd24-original-pull-secret") pod "global-pull-secret-syncer-fdgv8" (UID: "6bf1d484-4b82-487c-bcf1-be189dabfd24") : object "kube-system"/"original-pull-secret" not registered Jul 28 16:35:55.370234 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:55.369587 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xftt8\" (UniqueName: \"kubernetes.io/projected/45e07f9b-6993-4b7d-bf17-197b21c25a4b-kube-api-access-xftt8\") pod \"network-check-target-wq5zz\" (UID: \"45e07f9b-6993-4b7d-bf17-197b21c25a4b\") " pod="openshift-network-diagnostics/network-check-target-wq5zz" Jul 28 16:35:55.370234 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:55.369771 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 16:35:55.370234 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:55.369794 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 16:35:55.370234 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:55.369808 2563 projected.go:196] Error preparing data for projected volume kube-api-access-xftt8 for pod openshift-network-diagnostics/network-check-target-wq5zz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 16:35:55.370234 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:55.369871 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45e07f9b-6993-4b7d-bf17-197b21c25a4b-kube-api-access-xftt8 podName:45e07f9b-6993-4b7d-bf17-197b21c25a4b nodeName:}" failed. No retries permitted until 2026-07-28 16:35:57.369854251 +0000 UTC m=+6.163650509 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xftt8" (UniqueName: "kubernetes.io/projected/45e07f9b-6993-4b7d-bf17-197b21c25a4b-kube-api-access-xftt8") pod "network-check-target-wq5zz" (UID: "45e07f9b-6993-4b7d-bf17-197b21c25a4b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 16:35:55.584593 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:55.584453 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 16:30:53 +0000 UTC" deadline="2028-04-21 03:52:28.685635272 +0000 UTC" Jul 28 16:35:55.584593 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:55.584510 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15179h16m33.101130687s" Jul 28 16:35:55.726646 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:55.725925 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6dz7" Jul 28 16:35:55.726646 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:55.726064 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6dz7" podUID="da54b8f0-8ec1-4b28-a76b-037edb5bec20" Jul 28 16:35:55.726646 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:55.726485 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdgv8" Jul 28 16:35:55.726646 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:55.726575 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdgv8" podUID="6bf1d484-4b82-487c-bcf1-be189dabfd24" Jul 28 16:35:55.753304 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:55.752956 2563 generic.go:356] "Generic (PLEG): container finished" podID="0e448a3525fc7835a6d30329884309d8" containerID="e4b9a23be145a0d254268d2054b4e991b15d2ddf379ba1e424e3015a2f7576ea" exitCode=0 Jul 28 16:35:55.753304 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:55.753074 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-245.ec2.internal" event={"ID":"0e448a3525fc7835a6d30329884309d8","Type":"ContainerDied","Data":"e4b9a23be145a0d254268d2054b4e991b15d2ddf379ba1e424e3015a2f7576ea"} Jul 28 16:35:55.772866 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:55.772019 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-245.ec2.internal" podStartSLOduration=3.771996583 podStartE2EDuration="3.771996583s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 16:35:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:35:54.751711327 +0000 UTC m=+3.545507604" watchObservedRunningTime="2026-07-28 16:35:55.771996583 +0000 UTC m=+4.565792860" Jul 28 16:35:56.723686 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:56.723130 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wq5zz" Jul 28 16:35:56.723686 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:56.723293 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wq5zz" podUID="45e07f9b-6993-4b7d-bf17-197b21c25a4b" Jul 28 16:35:56.786811 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:56.786767 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-245.ec2.internal" event={"ID":"0e448a3525fc7835a6d30329884309d8","Type":"ContainerStarted","Data":"1553d33ca3b5c68974e8cbc0774abb1bd8d4037df3acf3a77f044fb10807b6ca"} Jul 28 16:35:57.287424 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:57.287386 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da54b8f0-8ec1-4b28-a76b-037edb5bec20-metrics-certs\") pod \"network-metrics-daemon-q6dz7\" (UID: \"da54b8f0-8ec1-4b28-a76b-037edb5bec20\") " pod="openshift-multus/network-metrics-daemon-q6dz7" Jul 28 16:35:57.287637 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:57.287479 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6bf1d484-4b82-487c-bcf1-be189dabfd24-original-pull-secret\") pod \"global-pull-secret-syncer-fdgv8\" (UID: \"6bf1d484-4b82-487c-bcf1-be189dabfd24\") " pod="kube-system/global-pull-secret-syncer-fdgv8" Jul 28 16:35:57.287707 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:57.287633 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 16:35:57.287707 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:57.287699 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bf1d484-4b82-487c-bcf1-be189dabfd24-original-pull-secret podName:6bf1d484-4b82-487c-bcf1-be189dabfd24 nodeName:}" failed. No retries permitted until 2026-07-28 16:36:01.287679792 +0000 UTC m=+10.081476138 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6bf1d484-4b82-487c-bcf1-be189dabfd24-original-pull-secret") pod "global-pull-secret-syncer-fdgv8" (UID: "6bf1d484-4b82-487c-bcf1-be189dabfd24") : object "kube-system"/"original-pull-secret" not registered Jul 28 16:35:57.288116 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:57.288095 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 16:35:57.288185 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:57.288156 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da54b8f0-8ec1-4b28-a76b-037edb5bec20-metrics-certs podName:da54b8f0-8ec1-4b28-a76b-037edb5bec20 nodeName:}" failed. No retries permitted until 2026-07-28 16:36:01.288141672 +0000 UTC m=+10.081937930 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/da54b8f0-8ec1-4b28-a76b-037edb5bec20-metrics-certs") pod "network-metrics-daemon-q6dz7" (UID: "da54b8f0-8ec1-4b28-a76b-037edb5bec20") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 16:35:57.387996 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:57.387932 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xftt8\" (UniqueName: \"kubernetes.io/projected/45e07f9b-6993-4b7d-bf17-197b21c25a4b-kube-api-access-xftt8\") pod \"network-check-target-wq5zz\" (UID: \"45e07f9b-6993-4b7d-bf17-197b21c25a4b\") " pod="openshift-network-diagnostics/network-check-target-wq5zz" Jul 28 16:35:57.388160 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:57.388105 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 16:35:57.388160 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:57.388124 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 16:35:57.388160 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:57.388136 2563 projected.go:196] Error preparing data for projected volume kube-api-access-xftt8 for pod openshift-network-diagnostics/network-check-target-wq5zz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 16:35:57.388333 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:57.388195 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45e07f9b-6993-4b7d-bf17-197b21c25a4b-kube-api-access-xftt8 podName:45e07f9b-6993-4b7d-bf17-197b21c25a4b nodeName:}" failed. No retries permitted until 2026-07-28 16:36:01.38817698 +0000 UTC m=+10.181973236 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xftt8" (UniqueName: "kubernetes.io/projected/45e07f9b-6993-4b7d-bf17-197b21c25a4b-kube-api-access-xftt8") pod "network-check-target-wq5zz" (UID: "45e07f9b-6993-4b7d-bf17-197b21c25a4b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 16:35:57.726948 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:57.726186 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6dz7" Jul 28 16:35:57.726948 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:57.726343 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6dz7" podUID="da54b8f0-8ec1-4b28-a76b-037edb5bec20" Jul 28 16:35:57.726948 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:57.726420 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdgv8" Jul 28 16:35:57.726948 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:57.726493 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdgv8" podUID="6bf1d484-4b82-487c-bcf1-be189dabfd24" Jul 28 16:35:58.723307 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:58.723265 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wq5zz" Jul 28 16:35:58.723480 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:58.723402 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wq5zz" podUID="45e07f9b-6993-4b7d-bf17-197b21c25a4b" Jul 28 16:35:59.723886 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:59.723507 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6dz7" Jul 28 16:35:59.723886 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:59.723692 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6dz7" podUID="da54b8f0-8ec1-4b28-a76b-037edb5bec20" Jul 28 16:35:59.723886 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:35:59.723725 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdgv8" Jul 28 16:35:59.723886 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:35:59.723813 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdgv8" podUID="6bf1d484-4b82-487c-bcf1-be189dabfd24" Jul 28 16:36:00.723889 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:00.723852 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wq5zz" Jul 28 16:36:00.724366 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:00.723987 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wq5zz" podUID="45e07f9b-6993-4b7d-bf17-197b21c25a4b" Jul 28 16:36:01.329532 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:01.329492 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6bf1d484-4b82-487c-bcf1-be189dabfd24-original-pull-secret\") pod \"global-pull-secret-syncer-fdgv8\" (UID: \"6bf1d484-4b82-487c-bcf1-be189dabfd24\") " pod="kube-system/global-pull-secret-syncer-fdgv8" Jul 28 16:36:01.329713 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:01.329561 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da54b8f0-8ec1-4b28-a76b-037edb5bec20-metrics-certs\") pod \"network-metrics-daemon-q6dz7\" (UID: \"da54b8f0-8ec1-4b28-a76b-037edb5bec20\") " pod="openshift-multus/network-metrics-daemon-q6dz7" Jul 28 16:36:01.329713 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:01.329653 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 16:36:01.329795 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:01.329749 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bf1d484-4b82-487c-bcf1-be189dabfd24-original-pull-secret podName:6bf1d484-4b82-487c-bcf1-be189dabfd24 nodeName:}" failed. No retries permitted until 2026-07-28 16:36:09.329725881 +0000 UTC m=+18.123522159 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6bf1d484-4b82-487c-bcf1-be189dabfd24-original-pull-secret") pod "global-pull-secret-syncer-fdgv8" (UID: "6bf1d484-4b82-487c-bcf1-be189dabfd24") : object "kube-system"/"original-pull-secret" not registered Jul 28 16:36:01.329795 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:01.329772 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 16:36:01.329874 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:01.329825 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da54b8f0-8ec1-4b28-a76b-037edb5bec20-metrics-certs podName:da54b8f0-8ec1-4b28-a76b-037edb5bec20 nodeName:}" failed. No retries permitted until 2026-07-28 16:36:09.329809418 +0000 UTC m=+18.123605677 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/da54b8f0-8ec1-4b28-a76b-037edb5bec20-metrics-certs") pod "network-metrics-daemon-q6dz7" (UID: "da54b8f0-8ec1-4b28-a76b-037edb5bec20") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 16:36:01.430602 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:01.430280 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xftt8\" (UniqueName: \"kubernetes.io/projected/45e07f9b-6993-4b7d-bf17-197b21c25a4b-kube-api-access-xftt8\") pod \"network-check-target-wq5zz\" (UID: \"45e07f9b-6993-4b7d-bf17-197b21c25a4b\") " pod="openshift-network-diagnostics/network-check-target-wq5zz" Jul 28 16:36:01.430602 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:01.430480 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 16:36:01.430602 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:01.430505 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 16:36:01.430602 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:01.430520 2563 projected.go:196] Error preparing data for projected volume kube-api-access-xftt8 for pod openshift-network-diagnostics/network-check-target-wq5zz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 16:36:01.430602 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:01.430580 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45e07f9b-6993-4b7d-bf17-197b21c25a4b-kube-api-access-xftt8 podName:45e07f9b-6993-4b7d-bf17-197b21c25a4b nodeName:}" failed. No retries permitted until 2026-07-28 16:36:09.430562364 +0000 UTC m=+18.224358638 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xftt8" (UniqueName: "kubernetes.io/projected/45e07f9b-6993-4b7d-bf17-197b21c25a4b-kube-api-access-xftt8") pod "network-check-target-wq5zz" (UID: "45e07f9b-6993-4b7d-bf17-197b21c25a4b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 16:36:01.725430 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:01.724703 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6dz7" Jul 28 16:36:01.725430 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:01.724843 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6dz7" podUID="da54b8f0-8ec1-4b28-a76b-037edb5bec20" Jul 28 16:36:01.725430 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:01.725244 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdgv8" Jul 28 16:36:01.725430 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:01.725338 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdgv8" podUID="6bf1d484-4b82-487c-bcf1-be189dabfd24" Jul 28 16:36:02.723672 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:02.723575 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wq5zz" Jul 28 16:36:02.723841 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:02.723749 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wq5zz" podUID="45e07f9b-6993-4b7d-bf17-197b21c25a4b" Jul 28 16:36:03.723311 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:03.723272 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6dz7" Jul 28 16:36:03.723786 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:03.723430 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6dz7" podUID="da54b8f0-8ec1-4b28-a76b-037edb5bec20" Jul 28 16:36:03.723786 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:03.723459 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdgv8" Jul 28 16:36:03.723786 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:03.723566 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdgv8" podUID="6bf1d484-4b82-487c-bcf1-be189dabfd24" Jul 28 16:36:04.723493 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:04.723456 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wq5zz" Jul 28 16:36:04.723944 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:04.723581 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wq5zz" podUID="45e07f9b-6993-4b7d-bf17-197b21c25a4b" Jul 28 16:36:05.723762 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:05.723728 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6dz7" Jul 28 16:36:05.724221 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:05.723878 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6dz7" podUID="da54b8f0-8ec1-4b28-a76b-037edb5bec20" Jul 28 16:36:05.724221 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:05.723937 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdgv8" Jul 28 16:36:05.724221 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:05.724082 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdgv8" podUID="6bf1d484-4b82-487c-bcf1-be189dabfd24" Jul 28 16:36:06.724206 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:06.724165 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wq5zz" Jul 28 16:36:06.724641 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:06.724301 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wq5zz" podUID="45e07f9b-6993-4b7d-bf17-197b21c25a4b" Jul 28 16:36:07.723537 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:07.723498 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdgv8" Jul 28 16:36:07.723537 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:07.723531 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6dz7" Jul 28 16:36:07.723804 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:07.723693 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdgv8" podUID="6bf1d484-4b82-487c-bcf1-be189dabfd24" Jul 28 16:36:07.723804 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:07.723785 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6dz7" podUID="da54b8f0-8ec1-4b28-a76b-037edb5bec20" Jul 28 16:36:08.724137 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:08.724100 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wq5zz" Jul 28 16:36:08.724642 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:08.724215 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wq5zz" podUID="45e07f9b-6993-4b7d-bf17-197b21c25a4b" Jul 28 16:36:09.390648 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:09.390598 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da54b8f0-8ec1-4b28-a76b-037edb5bec20-metrics-certs\") pod \"network-metrics-daemon-q6dz7\" (UID: \"da54b8f0-8ec1-4b28-a76b-037edb5bec20\") " pod="openshift-multus/network-metrics-daemon-q6dz7" Jul 28 16:36:09.390833 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:09.390799 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 16:36:09.390833 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:09.390813 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6bf1d484-4b82-487c-bcf1-be189dabfd24-original-pull-secret\") pod \"global-pull-secret-syncer-fdgv8\" (UID: \"6bf1d484-4b82-487c-bcf1-be189dabfd24\") " pod="kube-system/global-pull-secret-syncer-fdgv8" Jul 28 16:36:09.390957 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:09.390886 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da54b8f0-8ec1-4b28-a76b-037edb5bec20-metrics-certs podName:da54b8f0-8ec1-4b28-a76b-037edb5bec20 nodeName:}" failed. No retries permitted until 2026-07-28 16:36:25.390863559 +0000 UTC m=+34.184659832 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/da54b8f0-8ec1-4b28-a76b-037edb5bec20-metrics-certs") pod "network-metrics-daemon-q6dz7" (UID: "da54b8f0-8ec1-4b28-a76b-037edb5bec20") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 16:36:09.390957 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:09.390905 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 16:36:09.390957 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:09.390945 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bf1d484-4b82-487c-bcf1-be189dabfd24-original-pull-secret podName:6bf1d484-4b82-487c-bcf1-be189dabfd24 nodeName:}" failed. No retries permitted until 2026-07-28 16:36:25.390933399 +0000 UTC m=+34.184729666 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6bf1d484-4b82-487c-bcf1-be189dabfd24-original-pull-secret") pod "global-pull-secret-syncer-fdgv8" (UID: "6bf1d484-4b82-487c-bcf1-be189dabfd24") : object "kube-system"/"original-pull-secret" not registered Jul 28 16:36:09.491181 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:09.491144 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xftt8\" (UniqueName: \"kubernetes.io/projected/45e07f9b-6993-4b7d-bf17-197b21c25a4b-kube-api-access-xftt8\") pod \"network-check-target-wq5zz\" (UID: \"45e07f9b-6993-4b7d-bf17-197b21c25a4b\") " pod="openshift-network-diagnostics/network-check-target-wq5zz" Jul 28 16:36:09.491362 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:09.491308 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 16:36:09.491362 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:09.491327 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 16:36:09.491362 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:09.491339 2563 projected.go:196] Error preparing data for projected volume kube-api-access-xftt8 for pod openshift-network-diagnostics/network-check-target-wq5zz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 16:36:09.491500 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:09.491410 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45e07f9b-6993-4b7d-bf17-197b21c25a4b-kube-api-access-xftt8 podName:45e07f9b-6993-4b7d-bf17-197b21c25a4b nodeName:}" failed. No retries permitted until 2026-07-28 16:36:25.491389456 +0000 UTC m=+34.285185733 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xftt8" (UniqueName: "kubernetes.io/projected/45e07f9b-6993-4b7d-bf17-197b21c25a4b-kube-api-access-xftt8") pod "network-check-target-wq5zz" (UID: "45e07f9b-6993-4b7d-bf17-197b21c25a4b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 16:36:09.723626 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:09.723522 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdgv8" Jul 28 16:36:09.723775 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:09.723675 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdgv8" podUID="6bf1d484-4b82-487c-bcf1-be189dabfd24" Jul 28 16:36:09.723775 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:09.723719 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6dz7" Jul 28 16:36:09.723902 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:09.723816 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6dz7" podUID="da54b8f0-8ec1-4b28-a76b-037edb5bec20" Jul 28 16:36:10.723743 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:10.723705 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wq5zz" Jul 28 16:36:10.724178 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:10.723844 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wq5zz" podUID="45e07f9b-6993-4b7d-bf17-197b21c25a4b" Jul 28 16:36:11.725108 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:11.725070 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6dz7" Jul 28 16:36:11.725499 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:11.725206 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6dz7" podUID="da54b8f0-8ec1-4b28-a76b-037edb5bec20" Jul 28 16:36:11.725499 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:11.725259 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdgv8" Jul 28 16:36:11.725499 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:11.725373 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdgv8" podUID="6bf1d484-4b82-487c-bcf1-be189dabfd24" Jul 28 16:36:12.723100 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:12.723065 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wq5zz" Jul 28 16:36:12.723246 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:12.723173 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wq5zz" podUID="45e07f9b-6993-4b7d-bf17-197b21c25a4b" Jul 28 16:36:13.723653 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:13.723286 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdgv8" Jul 28 16:36:13.724509 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:13.723289 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6dz7" Jul 28 16:36:13.724509 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:13.723784 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdgv8" podUID="6bf1d484-4b82-487c-bcf1-be189dabfd24" Jul 28 16:36:13.724509 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:13.723836 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6dz7" podUID="da54b8f0-8ec1-4b28-a76b-037edb5bec20" Jul 28 16:36:13.821346 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:13.821305 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4899s" event={"ID":"2613b1fa-f3a0-4a1b-a90c-029c1a1dae6d","Type":"ContainerStarted","Data":"68caa4eb1582dd14ed569ec68e50f73cc551e522762c0b9acf19b07d7143e4dc"} Jul 28 16:36:13.822742 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:13.822716 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pwcjg" event={"ID":"258401ce-b809-4fe8-8c76-f64168a32d6e","Type":"ContainerStarted","Data":"a654bd6c5606a733ac28000750354b24481b9b3e3045a832c33967eb73b0f465"} Jul 28 16:36:13.824126 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:13.824104 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tlxzt" event={"ID":"c5a59f48-8e47-4505-97b6-01f136669bd8","Type":"ContainerStarted","Data":"e3f43fb0f911ac7736e5b0424e23d05ba110fc74dfc17b00642b4fc7a7337d86"} Jul 28 16:36:13.826626 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:13.826592 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vjvs7_021148b1-76cd-486f-a99d-e45527a9323e/ovn-acl-logging/0.log" Jul 28 16:36:13.826965 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:13.826946 2563 generic.go:356] "Generic (PLEG): container finished" podID="021148b1-76cd-486f-a99d-e45527a9323e" containerID="0f933db0a1246e1d58e2e403282df6dc3a3a62d02e77bd40fbcb43736ca4bdaa" exitCode=1 Jul 28 16:36:13.827031 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:13.827014 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" event={"ID":"021148b1-76cd-486f-a99d-e45527a9323e","Type":"ContainerStarted","Data":"5959ba24c355cf4143c7b20872445463216323a7608ea310fe502e0c31dc3fd2"} Jul 28 16:36:13.827107 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:13.827089 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" event={"ID":"021148b1-76cd-486f-a99d-e45527a9323e","Type":"ContainerStarted","Data":"10a5ef078fd2d2957ec1d7c9b6ec4e71a6d0d23341b938edd3850130a52c3c72"} Jul 28 16:36:13.827194 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:13.827133 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" event={"ID":"021148b1-76cd-486f-a99d-e45527a9323e","Type":"ContainerStarted","Data":"b5650f4198f209c6281560b14b29f689e665f8b55948f16ff7b0e550fa5cf4cd"} Jul 28 16:36:13.827194 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:13.827162 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" event={"ID":"021148b1-76cd-486f-a99d-e45527a9323e","Type":"ContainerDied","Data":"0f933db0a1246e1d58e2e403282df6dc3a3a62d02e77bd40fbcb43736ca4bdaa"} Jul 28 16:36:13.827412 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:13.827249 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" event={"ID":"021148b1-76cd-486f-a99d-e45527a9323e","Type":"ContainerStarted","Data":"fb1868d57cfec7ed8495c0c60d99e074956418a6d5f8b33ba8049a6fae31bbe2"} Jul 28 16:36:13.828545 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:13.828526 2563 generic.go:356] "Generic (PLEG): container finished" podID="eb488c90-4340-45eb-bb7b-003ef9ca81d1" containerID="8fc1346698af4111632d23b3d596749e9dba4ce31d112e864343d71556095bd7" exitCode=0 Jul 28 16:36:13.828644 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:13.828587 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4zxv6" event={"ID":"eb488c90-4340-45eb-bb7b-003ef9ca81d1","Type":"ContainerDied","Data":"8fc1346698af4111632d23b3d596749e9dba4ce31d112e864343d71556095bd7"} Jul 28 16:36:13.829951 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:13.829920 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xr8r8" event={"ID":"f0f2ba44-e234-4d76-9d0d-a152fd55e253","Type":"ContainerStarted","Data":"b164370e68a0730236f4abbabb585d36d030b8c46bb2092c135caa591d32d94b"} Jul 28 16:36:13.831362 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:13.831344 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q82xs" event={"ID":"6ba0ffc7-9736-4f5e-86de-52a97b2a17e7","Type":"ContainerStarted","Data":"6cb72ec72a0570228cfb4dccf29af55ca809e752fa902536290b2d3a95efc2c9"} Jul 28 16:36:13.832649 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:13.832627 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kwxqv" event={"ID":"90ae3dbc-89ae-4464-b7db-3152c533ee19","Type":"ContainerStarted","Data":"435740637f383496f3a27ec24f942321b6a28df60ed721ef8db0ccf23ca19b8b"} Jul 28 16:36:13.836447 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:13.836390 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-245.ec2.internal" podStartSLOduration=21.836354233 podStartE2EDuration="21.836354233s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 16:35:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:35:56.804518787 +0000 UTC m=+5.598315055" watchObservedRunningTime="2026-07-28 16:36:13.836354233 +0000 UTC m=+22.630150506" Jul 28 16:36:13.836824 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:13.836797 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4899s" podStartSLOduration=4.328136096 podStartE2EDuration="22.836787871s" totalImagesPullingTime="18.508651775s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 16:35:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:36:13.836433385 +0000 UTC m=+22.630229662" watchObservedRunningTime="2026-07-28 16:36:13.836787871 +0000 UTC m=+22.630584183" Jul 28 16:36:13.874232 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:13.874169 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-pwcjg" podStartSLOduration=12.406037347 podStartE2EDuration="22.874146845s" totalImagesPullingTime="10.468109498s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:35:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:36:13.873431595 +0000 UTC m=+22.667227875" watchObservedRunningTime="2026-07-28 16:36:13.874146845 +0000 UTC m=+22.667943122" Jul 28 16:36:13.892480 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:13.892379 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-q82xs" podStartSLOduration=4.344391297 podStartE2EDuration="22.892356731s" totalImagesPullingTime="18.547965434s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 16:35:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:36:13.891251609 +0000 UTC m=+22.685047884" watchObservedRunningTime="2026-07-28 16:36:13.892356731 +0000 UTC m=+22.686153008" Jul 28 16:36:13.913361 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:13.913312 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kwxqv" podStartSLOduration=4.396924886 podStartE2EDuration="22.913291063s" totalImagesPullingTime="18.516366177s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 16:35:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:36:13.912703273 +0000 UTC m=+22.706499549" watchObservedRunningTime="2026-07-28 16:36:13.913291063 +0000 UTC m=+22.707087340" Jul 28 16:36:13.931306 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:13.931246 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-xr8r8" podStartSLOduration=4.410251233 podStartE2EDuration="22.931225114s" totalImagesPullingTime="18.520973881s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 16:35:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:36:13.929733183 +0000 UTC m=+22.723529460" watchObservedRunningTime="2026-07-28 16:36:13.931225114 +0000 UTC m=+22.725021392" Jul 28 16:36:14.438752 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:14.438725 2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 28 16:36:14.607751 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:14.607593 2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T16:36:14.438746932Z","UUID":"bc1c864d-f3dd-44d3-8667-df1d53bcd2f9","Handler":null,"Name":"","Endpoint":""} Jul 28 16:36:14.609033 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:14.609005 2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 28 16:36:14.609167 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:14.609046 2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 28 16:36:14.723835 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:14.723798 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wq5zz" Jul 28 16:36:14.724283 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:14.723938 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wq5zz" podUID="45e07f9b-6993-4b7d-bf17-197b21c25a4b" Jul 28 16:36:14.837552 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:14.837513 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tlxzt" event={"ID":"c5a59f48-8e47-4505-97b6-01f136669bd8","Type":"ContainerStarted","Data":"e1ff2fd6aed49b26455404ec045b4902a7bcb0361bc785ecd3f84d8249e2c806"} Jul 28 16:36:14.840644 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:14.840604 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vjvs7_021148b1-76cd-486f-a99d-e45527a9323e/ovn-acl-logging/0.log" Jul 28 16:36:14.841184 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:14.841157 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" event={"ID":"021148b1-76cd-486f-a99d-e45527a9323e","Type":"ContainerStarted","Data":"95fc70962b32e5ebf3a4c132cc7d1b25019425dabeb84b3d4e80fabf96dfd92c"} Jul 28 16:36:14.842758 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:14.842706 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-shk5x" event={"ID":"3f9f655d-f123-4c01-ab93-61377299680a","Type":"ContainerStarted","Data":"56a042222ea677b2a50cf95a933ee0ef5d1d96e432967734f8bb93ca170740a5"} Jul 28 16:36:14.861219 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:14.861129 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-shk5x" podStartSLOduration=5.344735922 podStartE2EDuration="23.861111207s" totalImagesPullingTime="18.516375285s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 16:35:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:36:14.860659969 +0000 UTC m=+23.654456244" watchObservedRunningTime="2026-07-28 16:36:14.861111207 +0000 UTC m=+23.654907483" Jul 28 16:36:15.723801 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:15.723773 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6dz7" Jul 28 16:36:15.723964 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:15.723920 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6dz7" podUID="da54b8f0-8ec1-4b28-a76b-037edb5bec20" Jul 28 16:36:15.724208 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:15.723966 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdgv8" Jul 28 16:36:15.724208 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:15.724074 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdgv8" podUID="6bf1d484-4b82-487c-bcf1-be189dabfd24" Jul 28 16:36:15.847643 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:15.847579 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tlxzt" event={"ID":"c5a59f48-8e47-4505-97b6-01f136669bd8","Type":"ContainerStarted","Data":"0ca3fabd28b19783ca44a6d3872b4988c349fc3f5da78fe3f1d27a90b865a823"} Jul 28 16:36:15.867318 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:15.867269 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tlxzt" podStartSLOduration=4.083971827 podStartE2EDuration="24.867252155s" totalImagesPullingTime="20.783280328s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 16:35:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:36:15.866806534 +0000 UTC m=+24.660602812" watchObservedRunningTime="2026-07-28 16:36:15.867252155 +0000 UTC m=+24.661048431" Jul 28 16:36:16.724152 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:16.723965 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wq5zz" Jul 28 16:36:16.724582 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:16.724241 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wq5zz" podUID="45e07f9b-6993-4b7d-bf17-197b21c25a4b" Jul 28 16:36:17.723452 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:17.723416 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6dz7" Jul 28 16:36:17.723677 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:17.723556 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6dz7" podUID="da54b8f0-8ec1-4b28-a76b-037edb5bec20" Jul 28 16:36:17.723677 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:17.723626 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdgv8" Jul 28 16:36:17.723801 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:17.723751 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdgv8" podUID="6bf1d484-4b82-487c-bcf1-be189dabfd24" Jul 28 16:36:17.830206 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:17.830182 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-pwcjg" Jul 28 16:36:17.830750 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:17.830706 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-pwcjg" Jul 28 16:36:17.851586 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:17.851561 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pwcjg" Jul 28 16:36:17.851948 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:17.851932 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pwcjg" Jul 28 16:36:18.723984 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:18.723949 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wq5zz" Jul 28 16:36:18.724193 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:18.724048 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wq5zz" podUID="45e07f9b-6993-4b7d-bf17-197b21c25a4b" Jul 28 16:36:18.856247 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:18.856217 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vjvs7_021148b1-76cd-486f-a99d-e45527a9323e/ovn-acl-logging/0.log" Jul 28 16:36:18.856796 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:18.856654 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" event={"ID":"021148b1-76cd-486f-a99d-e45527a9323e","Type":"ContainerStarted","Data":"c85772029fb0d4bb4cab82398262ca30abf3c6812e748b7f227cc0fe4cd988bc"} Jul 28 16:36:18.858495 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:18.858467 2563 generic.go:356] "Generic (PLEG): container finished" podID="eb488c90-4340-45eb-bb7b-003ef9ca81d1" containerID="4818458c97f2e88a42b4c90d54bdfa1500a38bdd7fbce06a8f7bf6a433a0f787" exitCode=0 Jul 28 16:36:18.858645 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:18.858549 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4zxv6" event={"ID":"eb488c90-4340-45eb-bb7b-003ef9ca81d1","Type":"ContainerDied","Data":"4818458c97f2e88a42b4c90d54bdfa1500a38bdd7fbce06a8f7bf6a433a0f787"} Jul 28 16:36:19.724102 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:19.724056 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6dz7" Jul 28 16:36:19.724283 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:19.724060 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdgv8" Jul 28 16:36:19.724283 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:19.724182 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6dz7" podUID="da54b8f0-8ec1-4b28-a76b-037edb5bec20" Jul 28 16:36:19.724283 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:19.724258 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdgv8" podUID="6bf1d484-4b82-487c-bcf1-be189dabfd24" Jul 28 16:36:20.723314 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:20.723139 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wq5zz" Jul 28 16:36:20.723832 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:20.723393 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wq5zz" podUID="45e07f9b-6993-4b7d-bf17-197b21c25a4b" Jul 28 16:36:20.865698 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:20.865670 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vjvs7_021148b1-76cd-486f-a99d-e45527a9323e/ovn-acl-logging/0.log" Jul 28 16:36:20.866027 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:20.865999 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" event={"ID":"021148b1-76cd-486f-a99d-e45527a9323e","Type":"ContainerStarted","Data":"57447256c3e90f8b3a251fc5aabfd84d29deeb333c087c46faeeb629d75e3718"} Jul 28 16:36:20.866259 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:20.866236 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:36:20.866493 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:20.866479 2563 scope.go:117] "RemoveContainer" containerID="0f933db0a1246e1d58e2e403282df6dc3a3a62d02e77bd40fbcb43736ca4bdaa" Jul 28 16:36:20.868271 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:20.868248 2563 generic.go:356] "Generic (PLEG): container finished" podID="eb488c90-4340-45eb-bb7b-003ef9ca81d1" containerID="cd87c44be6e3d5699cbf2d300c87d7cfafd30ed50787a98378e523305793d698" exitCode=0 Jul 28 16:36:20.868349 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:20.868297 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4zxv6" event={"ID":"eb488c90-4340-45eb-bb7b-003ef9ca81d1","Type":"ContainerDied","Data":"cd87c44be6e3d5699cbf2d300c87d7cfafd30ed50787a98378e523305793d698"} Jul 28 16:36:20.883948 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:20.883926 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:36:21.638359 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:21.638321 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:36:21.724946 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:21.724902 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6dz7" Jul 28 16:36:21.725419 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:21.725000 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6dz7" podUID="da54b8f0-8ec1-4b28-a76b-037edb5bec20" Jul 28 16:36:21.725419 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:21.725059 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdgv8" Jul 28 16:36:21.725419 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:21.725155 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdgv8" podUID="6bf1d484-4b82-487c-bcf1-be189dabfd24" Jul 28 16:36:21.873661 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:21.873631 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vjvs7_021148b1-76cd-486f-a99d-e45527a9323e/ovn-acl-logging/0.log" Jul 28 16:36:21.873992 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:21.873969 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" event={"ID":"021148b1-76cd-486f-a99d-e45527a9323e","Type":"ContainerStarted","Data":"7285e4cff502479061ff4e41b6a25040c0839be6850abb9b6ba2b153c1155768"} Jul 28 16:36:21.874151 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:21.874137 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:36:21.888660 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:21.888585 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:36:21.905213 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:21.905164 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" podStartSLOduration=12.142702231 podStartE2EDuration="30.905150867s" totalImagesPullingTime="18.762448636s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 16:35:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:36:21.904425729 +0000 UTC m=+30.698222010" watchObservedRunningTime="2026-07-28 16:36:21.905150867 +0000 UTC m=+30.698947142" Jul 28 16:36:22.485281 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:22.485044 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wq5zz"] Jul 28 16:36:22.485437 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:22.485387 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wq5zz" Jul 28 16:36:22.485516 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:22.485488 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wq5zz" podUID="45e07f9b-6993-4b7d-bf17-197b21c25a4b" Jul 28 16:36:22.486368 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:22.486342 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-q6dz7"] Jul 28 16:36:22.486476 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:22.486418 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fdgv8"] Jul 28 16:36:22.486546 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:22.486488 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdgv8" Jul 28 16:36:22.486597 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:22.486569 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6dz7" Jul 28 16:36:22.486597 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:22.486586 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdgv8" podUID="6bf1d484-4b82-487c-bcf1-be189dabfd24" Jul 28 16:36:22.486761 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:22.486739 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6dz7" podUID="da54b8f0-8ec1-4b28-a76b-037edb5bec20" Jul 28 16:36:22.878488 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:22.878450 2563 generic.go:356] "Generic (PLEG): container finished" podID="eb488c90-4340-45eb-bb7b-003ef9ca81d1" containerID="ba60c382edb743ab7a8160aaeda149677c35cc417613867a83989904092d4402" exitCode=0 Jul 28 16:36:22.879158 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:22.878538 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4zxv6" event={"ID":"eb488c90-4340-45eb-bb7b-003ef9ca81d1","Type":"ContainerDied","Data":"ba60c382edb743ab7a8160aaeda149677c35cc417613867a83989904092d4402"} Jul 28 16:36:23.723601 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:23.723564 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wq5zz" Jul 28 16:36:23.723789 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:23.723564 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6dz7" Jul 28 16:36:23.723789 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:23.723701 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wq5zz" podUID="45e07f9b-6993-4b7d-bf17-197b21c25a4b" Jul 28 16:36:23.723789 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:23.723564 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdgv8" Jul 28 16:36:23.723965 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:23.723810 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6dz7" podUID="da54b8f0-8ec1-4b28-a76b-037edb5bec20" Jul 28 16:36:23.723965 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:23.723920 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdgv8" podUID="6bf1d484-4b82-487c-bcf1-be189dabfd24" Jul 28 16:36:24.138895 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:24.138863 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:24.243070 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:24.243027 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:25.411518 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:25.411484 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6bf1d484-4b82-487c-bcf1-be189dabfd24-original-pull-secret\") pod \"global-pull-secret-syncer-fdgv8\" (UID: \"6bf1d484-4b82-487c-bcf1-be189dabfd24\") " pod="kube-system/global-pull-secret-syncer-fdgv8" Jul 28 16:36:25.412135 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:25.411535 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da54b8f0-8ec1-4b28-a76b-037edb5bec20-metrics-certs\") pod \"network-metrics-daemon-q6dz7\" (UID: \"da54b8f0-8ec1-4b28-a76b-037edb5bec20\") " pod="openshift-multus/network-metrics-daemon-q6dz7" Jul 28 16:36:25.412135 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:25.411662 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 16:36:25.412135 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:25.411716 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da54b8f0-8ec1-4b28-a76b-037edb5bec20-metrics-certs podName:da54b8f0-8ec1-4b28-a76b-037edb5bec20 nodeName:}" failed. No retries permitted until 2026-07-28 16:36:57.411703461 +0000 UTC m=+66.205499715 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/da54b8f0-8ec1-4b28-a76b-037edb5bec20-metrics-certs") pod "network-metrics-daemon-q6dz7" (UID: "da54b8f0-8ec1-4b28-a76b-037edb5bec20") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 16:36:25.412135 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:25.411663 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 16:36:25.412135 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:25.411805 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bf1d484-4b82-487c-bcf1-be189dabfd24-original-pull-secret podName:6bf1d484-4b82-487c-bcf1-be189dabfd24 nodeName:}" failed. No retries permitted until 2026-07-28 16:36:57.411787028 +0000 UTC m=+66.205583294 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6bf1d484-4b82-487c-bcf1-be189dabfd24-original-pull-secret") pod "global-pull-secret-syncer-fdgv8" (UID: "6bf1d484-4b82-487c-bcf1-be189dabfd24") : object "kube-system"/"original-pull-secret" not registered Jul 28 16:36:25.512969 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:25.512891 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xftt8\" (UniqueName: \"kubernetes.io/projected/45e07f9b-6993-4b7d-bf17-197b21c25a4b-kube-api-access-xftt8\") pod \"network-check-target-wq5zz\" (UID: \"45e07f9b-6993-4b7d-bf17-197b21c25a4b\") " pod="openshift-network-diagnostics/network-check-target-wq5zz" Jul 28 16:36:25.513140 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:25.513099 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 16:36:25.513140 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:25.513121 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 16:36:25.513140 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:25.513132 2563 projected.go:196] Error preparing data for projected volume kube-api-access-xftt8 for pod openshift-network-diagnostics/network-check-target-wq5zz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 16:36:25.513236 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:25.513189 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45e07f9b-6993-4b7d-bf17-197b21c25a4b-kube-api-access-xftt8 podName:45e07f9b-6993-4b7d-bf17-197b21c25a4b nodeName:}" failed. No retries permitted until 2026-07-28 16:36:57.51317638 +0000 UTC m=+66.306972634 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xftt8" (UniqueName: "kubernetes.io/projected/45e07f9b-6993-4b7d-bf17-197b21c25a4b-kube-api-access-xftt8") pod "network-check-target-wq5zz" (UID: "45e07f9b-6993-4b7d-bf17-197b21c25a4b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 16:36:25.723642 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:25.723538 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6dz7" Jul 28 16:36:25.723642 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:25.723597 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wq5zz" Jul 28 16:36:25.723642 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:25.723538 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdgv8" Jul 28 16:36:25.723889 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:25.723699 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6dz7" podUID="da54b8f0-8ec1-4b28-a76b-037edb5bec20" Jul 28 16:36:25.723889 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:25.723831 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdgv8" podUID="6bf1d484-4b82-487c-bcf1-be189dabfd24" Jul 28 16:36:25.723980 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:25.723920 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wq5zz" podUID="45e07f9b-6993-4b7d-bf17-197b21c25a4b" Jul 28 16:36:26.070178 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.070143 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-245.ec2.internal" event="NodeReady" Jul 28 16:36:26.070345 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.070303 2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 28 16:36:26.110110 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.110079 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7cb7b7498f-8m5rd"] Jul 28 16:36:26.112496 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.112469 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cb7b7498f-8m5rd" Jul 28 16:36:26.115539 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.115514 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 28 16:36:26.115722 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.115647 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rnw5h\"" Jul 28 16:36:26.115858 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.115821 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 28 16:36:26.116105 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.116004 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 28 16:36:26.120348 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.120106 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gklwd"] Jul 28 16:36:26.124153 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.124045 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zf2hl"] Jul 28 16:36:26.124272 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.124234 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gklwd" Jul 28 16:36:26.124600 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.124575 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 28 16:36:26.126158 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.126140 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zf2hl" Jul 28 16:36:26.127002 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.126981 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2sch7\"" Jul 28 16:36:26.127187 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.127168 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7cb7b7498f-8m5rd"] Jul 28 16:36:26.127291 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.127273 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 28 16:36:26.127291 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.127206 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 28 16:36:26.128678 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.128654 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 28 16:36:26.129063 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.129044 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 28 16:36:26.129209 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.129188 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 28 16:36:26.130194 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.130070 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-h56h7\"" Jul 28 16:36:26.131837 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.131818 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gklwd"] Jul 28 16:36:26.136110 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.136085 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zf2hl"] Jul 28 16:36:26.219532 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.219489 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbe94e0b-c8db-4021-bcaa-6667f1fa992a-metrics-tls\") pod \"dns-default-gklwd\" (UID: \"cbe94e0b-c8db-4021-bcaa-6667f1fa992a\") " pod="openshift-dns/dns-default-gklwd" Jul 28 16:36:26.219532 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.219531 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/edd02d28-85fb-4cc3-b755-6fec6ccb4425-registry-tls\") pod \"image-registry-7cb7b7498f-8m5rd\" (UID: \"edd02d28-85fb-4cc3-b755-6fec6ccb4425\") " pod="openshift-image-registry/image-registry-7cb7b7498f-8m5rd" Jul 28 16:36:26.219794 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.219568 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/edd02d28-85fb-4cc3-b755-6fec6ccb4425-ca-trust-extracted\") pod \"image-registry-7cb7b7498f-8m5rd\" (UID: \"edd02d28-85fb-4cc3-b755-6fec6ccb4425\") " pod="openshift-image-registry/image-registry-7cb7b7498f-8m5rd" Jul 28 16:36:26.219794 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.219587 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/edd02d28-85fb-4cc3-b755-6fec6ccb4425-bound-sa-token\") pod \"image-registry-7cb7b7498f-8m5rd\" (UID: \"edd02d28-85fb-4cc3-b755-6fec6ccb4425\") " pod="openshift-image-registry/image-registry-7cb7b7498f-8m5rd" Jul 28 16:36:26.219794 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.219664 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cbe94e0b-c8db-4021-bcaa-6667f1fa992a-config-volume\") pod \"dns-default-gklwd\" (UID: \"cbe94e0b-c8db-4021-bcaa-6667f1fa992a\") " pod="openshift-dns/dns-default-gklwd" Jul 28 16:36:26.219794 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.219698 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/edd02d28-85fb-4cc3-b755-6fec6ccb4425-installation-pull-secrets\") pod \"image-registry-7cb7b7498f-8m5rd\" (UID: \"edd02d28-85fb-4cc3-b755-6fec6ccb4425\") " pod="openshift-image-registry/image-registry-7cb7b7498f-8m5rd" Jul 28 16:36:26.219794 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.219728 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptvgd\" (UniqueName: \"kubernetes.io/projected/cbe94e0b-c8db-4021-bcaa-6667f1fa992a-kube-api-access-ptvgd\") pod \"dns-default-gklwd\" (UID: \"cbe94e0b-c8db-4021-bcaa-6667f1fa992a\") " pod="openshift-dns/dns-default-gklwd" Jul 28 16:36:26.219794 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.219779 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtk64\" (UniqueName: \"kubernetes.io/projected/632689f6-279a-4633-8bf2-f96c110383df-kube-api-access-xtk64\") pod \"ingress-canary-zf2hl\" (UID: \"632689f6-279a-4633-8bf2-f96c110383df\") " pod="openshift-ingress-canary/ingress-canary-zf2hl" Jul 28 16:36:26.220076 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.219797 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/edd02d28-85fb-4cc3-b755-6fec6ccb4425-image-registry-private-configuration\") pod \"image-registry-7cb7b7498f-8m5rd\" (UID: \"edd02d28-85fb-4cc3-b755-6fec6ccb4425\") " pod="openshift-image-registry/image-registry-7cb7b7498f-8m5rd" Jul 28 16:36:26.220076 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.219822 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/632689f6-279a-4633-8bf2-f96c110383df-cert\") pod \"ingress-canary-zf2hl\" (UID: \"632689f6-279a-4633-8bf2-f96c110383df\") " pod="openshift-ingress-canary/ingress-canary-zf2hl" Jul 28 16:36:26.220076 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.219845 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/edd02d28-85fb-4cc3-b755-6fec6ccb4425-registry-certificates\") pod \"image-registry-7cb7b7498f-8m5rd\" (UID: \"edd02d28-85fb-4cc3-b755-6fec6ccb4425\") " pod="openshift-image-registry/image-registry-7cb7b7498f-8m5rd" Jul 28 16:36:26.220076 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.219871 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbe94e0b-c8db-4021-bcaa-6667f1fa992a-tmp-dir\") pod \"dns-default-gklwd\" (UID: \"cbe94e0b-c8db-4021-bcaa-6667f1fa992a\") " pod="openshift-dns/dns-default-gklwd" Jul 28 16:36:26.220076 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.219892 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/edd02d28-85fb-4cc3-b755-6fec6ccb4425-trusted-ca\") pod \"image-registry-7cb7b7498f-8m5rd\" (UID: \"edd02d28-85fb-4cc3-b755-6fec6ccb4425\") " pod="openshift-image-registry/image-registry-7cb7b7498f-8m5rd" Jul 28 16:36:26.220076 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.219911 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4zpj\" (UniqueName: \"kubernetes.io/projected/edd02d28-85fb-4cc3-b755-6fec6ccb4425-kube-api-access-c4zpj\") pod \"image-registry-7cb7b7498f-8m5rd\" (UID: \"edd02d28-85fb-4cc3-b755-6fec6ccb4425\") " pod="openshift-image-registry/image-registry-7cb7b7498f-8m5rd" Jul 28 16:36:26.320932 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.320850 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cbe94e0b-c8db-4021-bcaa-6667f1fa992a-config-volume\") pod \"dns-default-gklwd\" (UID: \"cbe94e0b-c8db-4021-bcaa-6667f1fa992a\") " pod="openshift-dns/dns-default-gklwd" Jul 28 16:36:26.320932 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.320901 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/edd02d28-85fb-4cc3-b755-6fec6ccb4425-installation-pull-secrets\") pod \"image-registry-7cb7b7498f-8m5rd\" (UID: \"edd02d28-85fb-4cc3-b755-6fec6ccb4425\") " pod="openshift-image-registry/image-registry-7cb7b7498f-8m5rd" Jul 28 16:36:26.321155 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.320940 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptvgd\" (UniqueName: \"kubernetes.io/projected/cbe94e0b-c8db-4021-bcaa-6667f1fa992a-kube-api-access-ptvgd\") pod \"dns-default-gklwd\" (UID: \"cbe94e0b-c8db-4021-bcaa-6667f1fa992a\") " pod="openshift-dns/dns-default-gklwd" Jul 28 16:36:26.321155 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.320993 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtk64\" (UniqueName: \"kubernetes.io/projected/632689f6-279a-4633-8bf2-f96c110383df-kube-api-access-xtk64\") pod \"ingress-canary-zf2hl\" (UID: \"632689f6-279a-4633-8bf2-f96c110383df\") " pod="openshift-ingress-canary/ingress-canary-zf2hl" Jul 28 16:36:26.321155 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.321016 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/edd02d28-85fb-4cc3-b755-6fec6ccb4425-image-registry-private-configuration\") pod \"image-registry-7cb7b7498f-8m5rd\" (UID: \"edd02d28-85fb-4cc3-b755-6fec6ccb4425\") " pod="openshift-image-registry/image-registry-7cb7b7498f-8m5rd" Jul 28 16:36:26.321155 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.321051 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/632689f6-279a-4633-8bf2-f96c110383df-cert\") pod \"ingress-canary-zf2hl\" (UID: \"632689f6-279a-4633-8bf2-f96c110383df\") " pod="openshift-ingress-canary/ingress-canary-zf2hl" Jul 28 16:36:26.321381 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.321336 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/edd02d28-85fb-4cc3-b755-6fec6ccb4425-registry-certificates\") pod \"image-registry-7cb7b7498f-8m5rd\" (UID: \"edd02d28-85fb-4cc3-b755-6fec6ccb4425\") " pod="openshift-image-registry/image-registry-7cb7b7498f-8m5rd" Jul 28 16:36:26.321435 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.321420 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbe94e0b-c8db-4021-bcaa-6667f1fa992a-tmp-dir\") pod \"dns-default-gklwd\" (UID: \"cbe94e0b-c8db-4021-bcaa-6667f1fa992a\") " pod="openshift-dns/dns-default-gklwd" Jul 28 16:36:26.321472 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.321451 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/edd02d28-85fb-4cc3-b755-6fec6ccb4425-trusted-ca\") pod \"image-registry-7cb7b7498f-8m5rd\" (UID: \"edd02d28-85fb-4cc3-b755-6fec6ccb4425\") " pod="openshift-image-registry/image-registry-7cb7b7498f-8m5rd" Jul 28 16:36:26.321506 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.321480 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4zpj\" (UniqueName: \"kubernetes.io/projected/edd02d28-85fb-4cc3-b755-6fec6ccb4425-kube-api-access-c4zpj\") pod \"image-registry-7cb7b7498f-8m5rd\" (UID: \"edd02d28-85fb-4cc3-b755-6fec6ccb4425\") " pod="openshift-image-registry/image-registry-7cb7b7498f-8m5rd" Jul 28 16:36:26.321536 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.321519 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cbe94e0b-c8db-4021-bcaa-6667f1fa992a-config-volume\") pod \"dns-default-gklwd\" (UID: \"cbe94e0b-c8db-4021-bcaa-6667f1fa992a\") " pod="openshift-dns/dns-default-gklwd" Jul 28 16:36:26.321576 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.321536 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbe94e0b-c8db-4021-bcaa-6667f1fa992a-metrics-tls\") pod \"dns-default-gklwd\" (UID: \"cbe94e0b-c8db-4021-bcaa-6667f1fa992a\") " pod="openshift-dns/dns-default-gklwd" Jul 28 16:36:26.321576 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.321559 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/edd02d28-85fb-4cc3-b755-6fec6ccb4425-registry-tls\") pod \"image-registry-7cb7b7498f-8m5rd\" (UID: \"edd02d28-85fb-4cc3-b755-6fec6ccb4425\") " pod="openshift-image-registry/image-registry-7cb7b7498f-8m5rd" Jul 28 16:36:26.321680 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.321596 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/edd02d28-85fb-4cc3-b755-6fec6ccb4425-ca-trust-extracted\") pod \"image-registry-7cb7b7498f-8m5rd\" (UID: \"edd02d28-85fb-4cc3-b755-6fec6ccb4425\") " pod="openshift-image-registry/image-registry-7cb7b7498f-8m5rd" Jul 28 16:36:26.321680 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.321641 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/edd02d28-85fb-4cc3-b755-6fec6ccb4425-bound-sa-token\") pod \"image-registry-7cb7b7498f-8m5rd\" (UID: \"edd02d28-85fb-4cc3-b755-6fec6ccb4425\") " pod="openshift-image-registry/image-registry-7cb7b7498f-8m5rd" Jul 28 16:36:26.321766 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.321739 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbe94e0b-c8db-4021-bcaa-6667f1fa992a-tmp-dir\") pod \"dns-default-gklwd\" (UID: \"cbe94e0b-c8db-4021-bcaa-6667f1fa992a\") " pod="openshift-dns/dns-default-gklwd" Jul 28 16:36:26.321819 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:26.321767 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 16:36:26.321867 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:26.321848 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbe94e0b-c8db-4021-bcaa-6667f1fa992a-metrics-tls podName:cbe94e0b-c8db-4021-bcaa-6667f1fa992a nodeName:}" failed. No retries permitted until 2026-07-28 16:36:26.821821449 +0000 UTC m=+35.615617716 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cbe94e0b-c8db-4021-bcaa-6667f1fa992a-metrics-tls") pod "dns-default-gklwd" (UID: "cbe94e0b-c8db-4021-bcaa-6667f1fa992a") : secret "dns-default-metrics-tls" not found Jul 28 16:36:26.321952 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:26.321934 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 16:36:26.322007 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:26.321953 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cb7b7498f-8m5rd: secret "image-registry-tls" not found Jul 28 16:36:26.322117 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.322094 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/edd02d28-85fb-4cc3-b755-6fec6ccb4425-registry-certificates\") pod \"image-registry-7cb7b7498f-8m5rd\" (UID: \"edd02d28-85fb-4cc3-b755-6fec6ccb4425\") " pod="openshift-image-registry/image-registry-7cb7b7498f-8m5rd" Jul 28 16:36:26.322209 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:26.322128 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/edd02d28-85fb-4cc3-b755-6fec6ccb4425-registry-tls podName:edd02d28-85fb-4cc3-b755-6fec6ccb4425 nodeName:}" failed. No retries permitted until 2026-07-28 16:36:26.822113215 +0000 UTC m=+35.615909488 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/edd02d28-85fb-4cc3-b755-6fec6ccb4425-registry-tls") pod "image-registry-7cb7b7498f-8m5rd" (UID: "edd02d28-85fb-4cc3-b755-6fec6ccb4425") : secret "image-registry-tls" not found Jul 28 16:36:26.322447 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.322418 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/edd02d28-85fb-4cc3-b755-6fec6ccb4425-ca-trust-extracted\") pod \"image-registry-7cb7b7498f-8m5rd\" (UID: \"edd02d28-85fb-4cc3-b755-6fec6ccb4425\") " pod="openshift-image-registry/image-registry-7cb7b7498f-8m5rd" Jul 28 16:36:26.322823 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.322798 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/edd02d28-85fb-4cc3-b755-6fec6ccb4425-trusted-ca\") pod \"image-registry-7cb7b7498f-8m5rd\" (UID: \"edd02d28-85fb-4cc3-b755-6fec6ccb4425\") " pod="openshift-image-registry/image-registry-7cb7b7498f-8m5rd" Jul 28 16:36:26.325969 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.325946 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/edd02d28-85fb-4cc3-b755-6fec6ccb4425-image-registry-private-configuration\") pod \"image-registry-7cb7b7498f-8m5rd\" (UID: \"edd02d28-85fb-4cc3-b755-6fec6ccb4425\") " pod="openshift-image-registry/image-registry-7cb7b7498f-8m5rd" Jul 28 16:36:26.326076 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.325946 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/edd02d28-85fb-4cc3-b755-6fec6ccb4425-installation-pull-secrets\") pod \"image-registry-7cb7b7498f-8m5rd\" (UID: \"edd02d28-85fb-4cc3-b755-6fec6ccb4425\") " pod="openshift-image-registry/image-registry-7cb7b7498f-8m5rd" Jul 28 16:36:26.326076 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.325986 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/632689f6-279a-4633-8bf2-f96c110383df-cert\") pod \"ingress-canary-zf2hl\" (UID: \"632689f6-279a-4633-8bf2-f96c110383df\") " pod="openshift-ingress-canary/ingress-canary-zf2hl" Jul 28 16:36:26.330956 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.330903 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptvgd\" (UniqueName: \"kubernetes.io/projected/cbe94e0b-c8db-4021-bcaa-6667f1fa992a-kube-api-access-ptvgd\") pod \"dns-default-gklwd\" (UID: \"cbe94e0b-c8db-4021-bcaa-6667f1fa992a\") " pod="openshift-dns/dns-default-gklwd" Jul 28 16:36:26.331048 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.331012 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4zpj\" (UniqueName: \"kubernetes.io/projected/edd02d28-85fb-4cc3-b755-6fec6ccb4425-kube-api-access-c4zpj\") pod \"image-registry-7cb7b7498f-8m5rd\" (UID: \"edd02d28-85fb-4cc3-b755-6fec6ccb4425\") " pod="openshift-image-registry/image-registry-7cb7b7498f-8m5rd" Jul 28 16:36:26.331102 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.331056 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtk64\" (UniqueName: \"kubernetes.io/projected/632689f6-279a-4633-8bf2-f96c110383df-kube-api-access-xtk64\") pod \"ingress-canary-zf2hl\" (UID: \"632689f6-279a-4633-8bf2-f96c110383df\") " pod="openshift-ingress-canary/ingress-canary-zf2hl" Jul 28 16:36:26.331766 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.331743 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/edd02d28-85fb-4cc3-b755-6fec6ccb4425-bound-sa-token\") pod \"image-registry-7cb7b7498f-8m5rd\" (UID: \"edd02d28-85fb-4cc3-b755-6fec6ccb4425\") " pod="openshift-image-registry/image-registry-7cb7b7498f-8m5rd" Jul 28 16:36:26.446445 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.446406 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zf2hl" Jul 28 16:36:26.818528 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.818371 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zf2hl"] Jul 28 16:36:26.821826 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:36:26.821794 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod632689f6_279a_4633_8bf2_f96c110383df.slice/crio-a3d9e8efb33aba1f51435d49ecb70a08bfbaf06c12178bd3e6e978e5fd31b8a0 WatchSource:0}: Error finding container a3d9e8efb33aba1f51435d49ecb70a08bfbaf06c12178bd3e6e978e5fd31b8a0: Status 404 returned error can't find the container with id a3d9e8efb33aba1f51435d49ecb70a08bfbaf06c12178bd3e6e978e5fd31b8a0 Jul 28 16:36:26.825664 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.825639 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbe94e0b-c8db-4021-bcaa-6667f1fa992a-metrics-tls\") pod \"dns-default-gklwd\" (UID: \"cbe94e0b-c8db-4021-bcaa-6667f1fa992a\") " pod="openshift-dns/dns-default-gklwd" Jul 28 16:36:26.825724 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.825680 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/edd02d28-85fb-4cc3-b755-6fec6ccb4425-registry-tls\") pod \"image-registry-7cb7b7498f-8m5rd\" (UID: \"edd02d28-85fb-4cc3-b755-6fec6ccb4425\") " pod="openshift-image-registry/image-registry-7cb7b7498f-8m5rd" Jul 28 16:36:26.825825 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:26.825804 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 16:36:26.825857 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:26.825828 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 16:36:26.825857 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:26.825844 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cb7b7498f-8m5rd: secret "image-registry-tls" not found Jul 28 16:36:26.825923 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:26.825895 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbe94e0b-c8db-4021-bcaa-6667f1fa992a-metrics-tls podName:cbe94e0b-c8db-4021-bcaa-6667f1fa992a nodeName:}" failed. No retries permitted until 2026-07-28 16:36:27.825861606 +0000 UTC m=+36.619657875 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cbe94e0b-c8db-4021-bcaa-6667f1fa992a-metrics-tls") pod "dns-default-gklwd" (UID: "cbe94e0b-c8db-4021-bcaa-6667f1fa992a") : secret "dns-default-metrics-tls" not found Jul 28 16:36:26.825923 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:26.825916 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/edd02d28-85fb-4cc3-b755-6fec6ccb4425-registry-tls podName:edd02d28-85fb-4cc3-b755-6fec6ccb4425 nodeName:}" failed. No retries permitted until 2026-07-28 16:36:27.825906569 +0000 UTC m=+36.619702823 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/edd02d28-85fb-4cc3-b755-6fec6ccb4425-registry-tls") pod "image-registry-7cb7b7498f-8m5rd" (UID: "edd02d28-85fb-4cc3-b755-6fec6ccb4425") : secret "image-registry-tls" not found Jul 28 16:36:26.891285 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.891256 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4zxv6" event={"ID":"eb488c90-4340-45eb-bb7b-003ef9ca81d1","Type":"ContainerStarted","Data":"88ff1f600a2daf9ec8bf0edeb2ada32655e7c074c3312bcc8eb65793cb48ebcc"} Jul 28 16:36:26.892496 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:26.892471 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zf2hl" event={"ID":"632689f6-279a-4633-8bf2-f96c110383df","Type":"ContainerStarted","Data":"a3d9e8efb33aba1f51435d49ecb70a08bfbaf06c12178bd3e6e978e5fd31b8a0"} Jul 28 16:36:27.724194 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:27.724089 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6dz7" Jul 28 16:36:27.724194 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:27.724144 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wq5zz" Jul 28 16:36:27.724194 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:27.724089 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdgv8" Jul 28 16:36:27.729505 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:27.729479 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 16:36:27.729655 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:27.729532 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 16:36:27.729655 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:27.729643 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9n9cd\"" Jul 28 16:36:27.729789 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:27.729659 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 16:36:27.729789 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:27.729485 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nw5rm\"" Jul 28 16:36:27.729789 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:27.729763 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 16:36:27.832933 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:27.832890 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbe94e0b-c8db-4021-bcaa-6667f1fa992a-metrics-tls\") pod \"dns-default-gklwd\" (UID: \"cbe94e0b-c8db-4021-bcaa-6667f1fa992a\") " pod="openshift-dns/dns-default-gklwd" Jul 28 16:36:27.833088 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:27.832939 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/edd02d28-85fb-4cc3-b755-6fec6ccb4425-registry-tls\") pod \"image-registry-7cb7b7498f-8m5rd\" (UID: \"edd02d28-85fb-4cc3-b755-6fec6ccb4425\") " pod="openshift-image-registry/image-registry-7cb7b7498f-8m5rd" Jul 28 16:36:27.833088 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:27.833049 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 16:36:27.833187 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:27.833134 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbe94e0b-c8db-4021-bcaa-6667f1fa992a-metrics-tls podName:cbe94e0b-c8db-4021-bcaa-6667f1fa992a nodeName:}" failed. No retries permitted until 2026-07-28 16:36:29.833116677 +0000 UTC m=+38.626913160 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cbe94e0b-c8db-4021-bcaa-6667f1fa992a-metrics-tls") pod "dns-default-gklwd" (UID: "cbe94e0b-c8db-4021-bcaa-6667f1fa992a") : secret "dns-default-metrics-tls" not found Jul 28 16:36:27.833187 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:27.833134 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 16:36:27.833187 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:27.833150 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cb7b7498f-8m5rd: secret "image-registry-tls" not found Jul 28 16:36:27.833187 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:27.833181 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/edd02d28-85fb-4cc3-b755-6fec6ccb4425-registry-tls podName:edd02d28-85fb-4cc3-b755-6fec6ccb4425 nodeName:}" failed. No retries permitted until 2026-07-28 16:36:29.833171791 +0000 UTC m=+38.626968065 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/edd02d28-85fb-4cc3-b755-6fec6ccb4425-registry-tls") pod "image-registry-7cb7b7498f-8m5rd" (UID: "edd02d28-85fb-4cc3-b755-6fec6ccb4425") : secret "image-registry-tls" not found Jul 28 16:36:27.877384 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:27.877350 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:27.898734 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:27.898701 2563 generic.go:356] "Generic (PLEG): container finished" podID="eb488c90-4340-45eb-bb7b-003ef9ca81d1" containerID="88ff1f600a2daf9ec8bf0edeb2ada32655e7c074c3312bcc8eb65793cb48ebcc" exitCode=0 Jul 28 16:36:27.898892 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:27.898751 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4zxv6" event={"ID":"eb488c90-4340-45eb-bb7b-003ef9ca81d1","Type":"ContainerDied","Data":"88ff1f600a2daf9ec8bf0edeb2ada32655e7c074c3312bcc8eb65793cb48ebcc"} Jul 28 16:36:27.945776 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:27.945740 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:28.904827 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:28.904789 2563 generic.go:356] "Generic (PLEG): container finished" podID="eb488c90-4340-45eb-bb7b-003ef9ca81d1" containerID="00bd2e36a4f57ff673dfdb2a1742fe0043f23d6e554b64aae41e3e25e2c90588" exitCode=0 Jul 28 16:36:28.905286 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:28.904861 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4zxv6" event={"ID":"eb488c90-4340-45eb-bb7b-003ef9ca81d1","Type":"ContainerDied","Data":"00bd2e36a4f57ff673dfdb2a1742fe0043f23d6e554b64aae41e3e25e2c90588"} Jul 28 16:36:29.528497 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:29.528287 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:29.593449 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:29.593418 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:29.849975 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:29.849942 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbe94e0b-c8db-4021-bcaa-6667f1fa992a-metrics-tls\") pod \"dns-default-gklwd\" (UID: \"cbe94e0b-c8db-4021-bcaa-6667f1fa992a\") " pod="openshift-dns/dns-default-gklwd" Jul 28 16:36:29.849975 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:29.849977 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/edd02d28-85fb-4cc3-b755-6fec6ccb4425-registry-tls\") pod \"image-registry-7cb7b7498f-8m5rd\" (UID: \"edd02d28-85fb-4cc3-b755-6fec6ccb4425\") " pod="openshift-image-registry/image-registry-7cb7b7498f-8m5rd" Jul 28 16:36:29.850305 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:29.850089 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 16:36:29.850305 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:29.850100 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cb7b7498f-8m5rd: secret "image-registry-tls" not found Jul 28 16:36:29.850305 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:29.850102 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 16:36:29.850305 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:29.850156 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/edd02d28-85fb-4cc3-b755-6fec6ccb4425-registry-tls podName:edd02d28-85fb-4cc3-b755-6fec6ccb4425 nodeName:}" failed. No retries permitted until 2026-07-28 16:36:33.850141159 +0000 UTC m=+42.643937413 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/edd02d28-85fb-4cc3-b755-6fec6ccb4425-registry-tls") pod "image-registry-7cb7b7498f-8m5rd" (UID: "edd02d28-85fb-4cc3-b755-6fec6ccb4425") : secret "image-registry-tls" not found Jul 28 16:36:29.850305 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:29.850167 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbe94e0b-c8db-4021-bcaa-6667f1fa992a-metrics-tls podName:cbe94e0b-c8db-4021-bcaa-6667f1fa992a nodeName:}" failed. No retries permitted until 2026-07-28 16:36:33.850162241 +0000 UTC m=+42.643958495 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cbe94e0b-c8db-4021-bcaa-6667f1fa992a-metrics-tls") pod "dns-default-gklwd" (UID: "cbe94e0b-c8db-4021-bcaa-6667f1fa992a") : secret "dns-default-metrics-tls" not found Jul 28 16:36:29.909169 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:29.909135 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zf2hl" event={"ID":"632689f6-279a-4633-8bf2-f96c110383df","Type":"ContainerStarted","Data":"5b356e8b3643b159c2de3335abbad16fafb6c016a5f0c89d48fc612a85547192"} Jul 28 16:36:29.912281 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:29.912256 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4zxv6" event={"ID":"eb488c90-4340-45eb-bb7b-003ef9ca81d1","Type":"ContainerStarted","Data":"662e184de642ad3219a719cceb459d70e8f6813dfc771907704c019f31d844d1"} Jul 28 16:36:29.933810 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:29.933758 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zf2hl" podStartSLOduration=1.529938674 podStartE2EDuration="3.933738109s" totalImagesPullingTime="2.403799435s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:36:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:36:29.93306909 +0000 UTC m=+38.726865367" watchObservedRunningTime="2026-07-28 16:36:29.933738109 +0000 UTC m=+38.727534375" Jul 28 16:36:29.960047 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:29.959992 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4zxv6" podStartSLOduration=10.23514672 podStartE2EDuration="38.959969333s" totalImagesPullingTime="28.724822613s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 16:35:51 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:36:29.958132362 +0000 UTC m=+38.751928640" watchObservedRunningTime="2026-07-28 16:36:29.959969333 +0000 UTC m=+38.753765609" Jul 28 16:36:30.083670 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:30.083634 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:30.184460 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:30.184387 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:31.269538 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:31.269508 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:31.323291 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:31.323256 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:33.426070 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:33.426038 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:33.524328 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:33.524298 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:33.878895 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:33.878861 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbe94e0b-c8db-4021-bcaa-6667f1fa992a-metrics-tls\") pod \"dns-default-gklwd\" (UID: \"cbe94e0b-c8db-4021-bcaa-6667f1fa992a\") " pod="openshift-dns/dns-default-gklwd" Jul 28 16:36:33.878895 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:33.878895 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/edd02d28-85fb-4cc3-b755-6fec6ccb4425-registry-tls\") pod \"image-registry-7cb7b7498f-8m5rd\" (UID: \"edd02d28-85fb-4cc3-b755-6fec6ccb4425\") " pod="openshift-image-registry/image-registry-7cb7b7498f-8m5rd" Jul 28 16:36:33.879128 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:33.879021 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 16:36:33.879128 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:33.879021 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 16:36:33.879128 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:33.879099 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbe94e0b-c8db-4021-bcaa-6667f1fa992a-metrics-tls podName:cbe94e0b-c8db-4021-bcaa-6667f1fa992a nodeName:}" failed. No retries permitted until 2026-07-28 16:36:41.879078469 +0000 UTC m=+50.672874726 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cbe94e0b-c8db-4021-bcaa-6667f1fa992a-metrics-tls") pod "dns-default-gklwd" (UID: "cbe94e0b-c8db-4021-bcaa-6667f1fa992a") : secret "dns-default-metrics-tls" not found Jul 28 16:36:33.879128 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:33.879031 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cb7b7498f-8m5rd: secret "image-registry-tls" not found Jul 28 16:36:33.879326 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:33.879157 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/edd02d28-85fb-4cc3-b755-6fec6ccb4425-registry-tls podName:edd02d28-85fb-4cc3-b755-6fec6ccb4425 nodeName:}" failed. No retries permitted until 2026-07-28 16:36:41.879144777 +0000 UTC m=+50.672941031 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/edd02d28-85fb-4cc3-b755-6fec6ccb4425-registry-tls") pod "image-registry-7cb7b7498f-8m5rd" (UID: "edd02d28-85fb-4cc3-b755-6fec6ccb4425") : secret "image-registry-tls" not found Jul 28 16:36:34.153911 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:34.153831 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dcjrq"] Jul 28 16:36:34.188619 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:34.188581 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dcjrq"] Jul 28 16:36:34.188753 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:34.188713 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dcjrq" Jul 28 16:36:34.191197 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:34.191178 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2fqqs\"" Jul 28 16:36:34.191481 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:34.191468 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 28 16:36:34.191539 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:34.191472 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 28 16:36:34.192485 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:34.192468 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 28 16:36:34.192485 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:34.192481 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 28 16:36:34.196266 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:34.196245 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:34.257445 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:34.257419 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:34.281556 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:34.281536 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9-crio-socket\") pod \"insights-runtime-extractor-dcjrq\" (UID: \"73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9\") " pod="openshift-insights/insights-runtime-extractor-dcjrq" Jul 28 16:36:34.281670 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:34.281561 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dcjrq\" (UID: \"73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9\") " pod="openshift-insights/insights-runtime-extractor-dcjrq" Jul 28 16:36:34.281670 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:34.281579 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxhxp\" (UniqueName: \"kubernetes.io/projected/73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9-kube-api-access-kxhxp\") pod \"insights-runtime-extractor-dcjrq\" (UID: \"73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9\") " pod="openshift-insights/insights-runtime-extractor-dcjrq" Jul 28 16:36:34.281670 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:34.281601 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dcjrq\" (UID: \"73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9\") " pod="openshift-insights/insights-runtime-extractor-dcjrq" Jul 28 16:36:34.281768 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:34.281735 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9-data-volume\") pod \"insights-runtime-extractor-dcjrq\" (UID: \"73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9\") " pod="openshift-insights/insights-runtime-extractor-dcjrq" Jul 28 16:36:34.363938 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:34.363906 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:34.382038 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:34.382016 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9-crio-socket\") pod \"insights-runtime-extractor-dcjrq\" (UID: \"73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9\") " pod="openshift-insights/insights-runtime-extractor-dcjrq" Jul 28 16:36:34.382124 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:34.382045 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dcjrq\" (UID: \"73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9\") " pod="openshift-insights/insights-runtime-extractor-dcjrq" Jul 28 16:36:34.382124 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:34.382063 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxhxp\" (UniqueName: \"kubernetes.io/projected/73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9-kube-api-access-kxhxp\") pod \"insights-runtime-extractor-dcjrq\" (UID: \"73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9\") " pod="openshift-insights/insights-runtime-extractor-dcjrq" Jul 28 16:36:34.382124 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:34.382098 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dcjrq\" (UID: \"73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9\") " pod="openshift-insights/insights-runtime-extractor-dcjrq" Jul 28 16:36:34.382262 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:34.382144 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 16:36:34.382262 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:34.382164 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9-data-volume\") pod \"insights-runtime-extractor-dcjrq\" (UID: \"73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9\") " pod="openshift-insights/insights-runtime-extractor-dcjrq" Jul 28 16:36:34.382262 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:34.382218 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9-kube-rbac-proxy-cm podName:73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9 nodeName:}" failed. No retries permitted until 2026-07-28 16:36:34.882203256 +0000 UTC m=+43.675999511 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dcjrq" (UID: "73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9") : configmap "kube-rbac-proxy" not found Jul 28 16:36:34.382262 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:34.382231 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9-crio-socket\") pod \"insights-runtime-extractor-dcjrq\" (UID: \"73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9\") " pod="openshift-insights/insights-runtime-extractor-dcjrq" Jul 28 16:36:34.382435 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:34.382260 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 16:36:34.382435 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:34.382313 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9-insights-runtime-extractor-tls podName:73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9 nodeName:}" failed. No retries permitted until 2026-07-28 16:36:34.88230126 +0000 UTC m=+43.676097524 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dcjrq" (UID: "73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9") : secret "insights-runtime-extractor-tls" not found Jul 28 16:36:34.382506 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:34.382468 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9-data-volume\") pod \"insights-runtime-extractor-dcjrq\" (UID: \"73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9\") " pod="openshift-insights/insights-runtime-extractor-dcjrq" Jul 28 16:36:34.400178 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:34.400153 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxhxp\" (UniqueName: \"kubernetes.io/projected/73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9-kube-api-access-kxhxp\") pod \"insights-runtime-extractor-dcjrq\" (UID: \"73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9\") " pod="openshift-insights/insights-runtime-extractor-dcjrq" Jul 28 16:36:34.464993 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:34.459143 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:34.552772 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:34.552739 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:34.885692 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:34.885651 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dcjrq\" (UID: \"73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9\") " pod="openshift-insights/insights-runtime-extractor-dcjrq" Jul 28 16:36:34.885861 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:34.885805 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dcjrq\" (UID: \"73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9\") " pod="openshift-insights/insights-runtime-extractor-dcjrq" Jul 28 16:36:34.885861 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:34.885823 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 16:36:34.885941 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:34.885882 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 16:36:34.885941 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:34.885915 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9-insights-runtime-extractor-tls podName:73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9 nodeName:}" failed. No retries permitted until 2026-07-28 16:36:35.885895913 +0000 UTC m=+44.679692186 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dcjrq" (UID: "73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9") : secret "insights-runtime-extractor-tls" not found Jul 28 16:36:34.885941 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:34.885932 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9-kube-rbac-proxy-cm podName:73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9 nodeName:}" failed. No retries permitted until 2026-07-28 16:36:35.885924449 +0000 UTC m=+44.679720706 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dcjrq" (UID: "73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9") : configmap "kube-rbac-proxy" not found Jul 28 16:36:35.030734 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:35.030697 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:35.117804 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:35.117766 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:35.893743 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:35.893706 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dcjrq\" (UID: \"73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9\") " pod="openshift-insights/insights-runtime-extractor-dcjrq" Jul 28 16:36:35.893743 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:35.893747 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dcjrq\" (UID: \"73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9\") " pod="openshift-insights/insights-runtime-extractor-dcjrq" Jul 28 16:36:35.894289 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:35.893845 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 16:36:35.894289 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:35.893946 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9-kube-rbac-proxy-cm podName:73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9 nodeName:}" failed. No retries permitted until 2026-07-28 16:36:37.893926457 +0000 UTC m=+46.687722717 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dcjrq" (UID: "73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9") : configmap "kube-rbac-proxy" not found Jul 28 16:36:35.894289 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:35.893854 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 16:36:35.894289 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:35.894016 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9-insights-runtime-extractor-tls podName:73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9 nodeName:}" failed. No retries permitted until 2026-07-28 16:36:37.894003906 +0000 UTC m=+46.687800160 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dcjrq" (UID: "73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9") : secret "insights-runtime-extractor-tls" not found Jul 28 16:36:36.332487 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:36.332458 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xr8r8_f0f2ba44-e234-4d76-9d0d-a152fd55e253/dns-node-resolver/0.log" Jul 28 16:36:36.643135 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:36.643057 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-qbl79"] Jul 28 16:36:36.667044 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:36.667020 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-qbl79"] Jul 28 16:36:36.667182 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:36.667114 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-qbl79" Jul 28 16:36:36.670044 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:36.670022 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 28 16:36:36.670162 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:36.670070 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 28 16:36:36.671373 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:36.671350 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 28 16:36:36.671476 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:36.671374 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-mmnql\"" Jul 28 16:36:36.671476 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:36.671387 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 28 16:36:36.685502 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:36.685479 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:36.699472 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:36.699446 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b628b2c9-5f2d-4a73-b22b-147ec9c21329-signing-key\") pod \"service-ca-658d7b7c78-qbl79\" (UID: \"b628b2c9-5f2d-4a73-b22b-147ec9c21329\") " pod="openshift-service-ca/service-ca-658d7b7c78-qbl79" Jul 28 16:36:36.699573 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:36.699546 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b628b2c9-5f2d-4a73-b22b-147ec9c21329-signing-cabundle\") pod \"service-ca-658d7b7c78-qbl79\" (UID: \"b628b2c9-5f2d-4a73-b22b-147ec9c21329\") " pod="openshift-service-ca/service-ca-658d7b7c78-qbl79" Jul 28 16:36:36.699656 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:36.699574 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bssh5\" (UniqueName: \"kubernetes.io/projected/b628b2c9-5f2d-4a73-b22b-147ec9c21329-kube-api-access-bssh5\") pod \"service-ca-658d7b7c78-qbl79\" (UID: \"b628b2c9-5f2d-4a73-b22b-147ec9c21329\") " pod="openshift-service-ca/service-ca-658d7b7c78-qbl79" Jul 28 16:36:36.782605 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:36.782568 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:36.800851 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:36.800825 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b628b2c9-5f2d-4a73-b22b-147ec9c21329-signing-cabundle\") pod \"service-ca-658d7b7c78-qbl79\" (UID: \"b628b2c9-5f2d-4a73-b22b-147ec9c21329\") " pod="openshift-service-ca/service-ca-658d7b7c78-qbl79" Jul 28 16:36:36.800932 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:36.800857 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bssh5\" (UniqueName: \"kubernetes.io/projected/b628b2c9-5f2d-4a73-b22b-147ec9c21329-kube-api-access-bssh5\") pod \"service-ca-658d7b7c78-qbl79\" (UID: \"b628b2c9-5f2d-4a73-b22b-147ec9c21329\") " pod="openshift-service-ca/service-ca-658d7b7c78-qbl79" Jul 28 16:36:36.801015 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:36.800996 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b628b2c9-5f2d-4a73-b22b-147ec9c21329-signing-key\") pod \"service-ca-658d7b7c78-qbl79\" (UID: \"b628b2c9-5f2d-4a73-b22b-147ec9c21329\") " pod="openshift-service-ca/service-ca-658d7b7c78-qbl79" Jul 28 16:36:36.801468 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:36.801447 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b628b2c9-5f2d-4a73-b22b-147ec9c21329-signing-cabundle\") pod \"service-ca-658d7b7c78-qbl79\" (UID: \"b628b2c9-5f2d-4a73-b22b-147ec9c21329\") " pod="openshift-service-ca/service-ca-658d7b7c78-qbl79" Jul 28 16:36:36.803293 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:36.803261 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b628b2c9-5f2d-4a73-b22b-147ec9c21329-signing-key\") pod \"service-ca-658d7b7c78-qbl79\" (UID: \"b628b2c9-5f2d-4a73-b22b-147ec9c21329\") " pod="openshift-service-ca/service-ca-658d7b7c78-qbl79" Jul 28 16:36:36.809787 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:36.809764 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bssh5\" (UniqueName: \"kubernetes.io/projected/b628b2c9-5f2d-4a73-b22b-147ec9c21329-kube-api-access-bssh5\") pod \"service-ca-658d7b7c78-qbl79\" (UID: \"b628b2c9-5f2d-4a73-b22b-147ec9c21329\") " pod="openshift-service-ca/service-ca-658d7b7c78-qbl79" Jul 28 16:36:36.976321 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:36.976245 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-qbl79" Jul 28 16:36:37.115345 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:37.115314 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-qbl79"] Jul 28 16:36:37.118487 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:36:37.118462 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb628b2c9_5f2d_4a73_b22b_147ec9c21329.slice/crio-1fcb00aab9be005810a13bcc1e642fa5c1327d8bc65a0dd9b9951942d3557e77 WatchSource:0}: Error finding container 1fcb00aab9be005810a13bcc1e642fa5c1327d8bc65a0dd9b9951942d3557e77: Status 404 returned error can't find the container with id 1fcb00aab9be005810a13bcc1e642fa5c1327d8bc65a0dd9b9951942d3557e77 Jul 28 16:36:37.132528 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:37.132509 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4899s_2613b1fa-f3a0-4a1b-a90c-029c1a1dae6d/node-ca/0.log" Jul 28 16:36:37.533752 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:37.533719 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:37.909282 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:37.909207 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dcjrq\" (UID: \"73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9\") " pod="openshift-insights/insights-runtime-extractor-dcjrq" Jul 28 16:36:37.909282 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:37.909251 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dcjrq\" (UID: \"73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9\") " pod="openshift-insights/insights-runtime-extractor-dcjrq" Jul 28 16:36:37.909490 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:37.909356 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 16:36:37.909490 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:37.909404 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9-insights-runtime-extractor-tls podName:73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9 nodeName:}" failed. No retries permitted until 2026-07-28 16:36:41.909390268 +0000 UTC m=+50.703186522 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dcjrq" (UID: "73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9") : secret "insights-runtime-extractor-tls" not found Jul 28 16:36:37.909490 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:37.909435 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 16:36:37.909666 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:37.909497 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9-kube-rbac-proxy-cm podName:73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9 nodeName:}" failed. No retries permitted until 2026-07-28 16:36:41.909480224 +0000 UTC m=+50.703276483 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dcjrq" (UID: "73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9") : configmap "kube-rbac-proxy" not found Jul 28 16:36:37.933626 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:37.933580 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-qbl79" event={"ID":"b628b2c9-5f2d-4a73-b22b-147ec9c21329","Type":"ContainerStarted","Data":"1fcb00aab9be005810a13bcc1e642fa5c1327d8bc65a0dd9b9951942d3557e77"} Jul 28 16:36:38.132198 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:38.132166 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zf2hl_632689f6-279a-4633-8bf2-f96c110383df/serve-healthcheck-canary/0.log" Jul 28 16:36:39.942334 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:39.942296 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-qbl79" event={"ID":"b628b2c9-5f2d-4a73-b22b-147ec9c21329","Type":"ContainerStarted","Data":"e79fb74bc1051f3133fe31209f262214c09e33d57de52d11238e87437f3c0cec"} Jul 28 16:36:39.962911 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:39.962866 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-qbl79" podStartSLOduration=1.600687449 podStartE2EDuration="3.962851207s" totalImagesPullingTime="2.362163758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:36:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:36:39.962661674 +0000 UTC m=+48.756457950" watchObservedRunningTime="2026-07-28 16:36:39.962851207 +0000 UTC m=+48.756647482" Jul 28 16:36:40.359942 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:40.359905 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:40.726021 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:40.725929 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:40.907715 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:40.907683 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:41.010489 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:41.010399 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:41.110048 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:41.109997 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:41.278158 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:41.278063 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:41.412655 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:41.412622 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:41.520906 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:41.520874 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:41.627901 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:41.627869 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:41.692084 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:41.692052 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:41.941625 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:41.941519 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dcjrq\" (UID: \"73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9\") " pod="openshift-insights/insights-runtime-extractor-dcjrq" Jul 28 16:36:41.941625 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:41.941578 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbe94e0b-c8db-4021-bcaa-6667f1fa992a-metrics-tls\") pod \"dns-default-gklwd\" (UID: \"cbe94e0b-c8db-4021-bcaa-6667f1fa992a\") " pod="openshift-dns/dns-default-gklwd" Jul 28 16:36:41.941831 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:41.941694 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 16:36:41.941831 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:41.941721 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/edd02d28-85fb-4cc3-b755-6fec6ccb4425-registry-tls\") pod \"image-registry-7cb7b7498f-8m5rd\" (UID: \"edd02d28-85fb-4cc3-b755-6fec6ccb4425\") " pod="openshift-image-registry/image-registry-7cb7b7498f-8m5rd" Jul 28 16:36:41.941831 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:41.941746 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbe94e0b-c8db-4021-bcaa-6667f1fa992a-metrics-tls podName:cbe94e0b-c8db-4021-bcaa-6667f1fa992a nodeName:}" failed. No retries permitted until 2026-07-28 16:36:57.941732847 +0000 UTC m=+66.735529101 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cbe94e0b-c8db-4021-bcaa-6667f1fa992a-metrics-tls") pod "dns-default-gklwd" (UID: "cbe94e0b-c8db-4021-bcaa-6667f1fa992a") : secret "dns-default-metrics-tls" not found Jul 28 16:36:41.941831 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:41.941697 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 16:36:41.941831 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:41.941788 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 16:36:41.942018 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:41.941839 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cb7b7498f-8m5rd: secret "image-registry-tls" not found Jul 28 16:36:41.942018 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:41.941841 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9-insights-runtime-extractor-tls podName:73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9 nodeName:}" failed. No retries permitted until 2026-07-28 16:36:49.941827845 +0000 UTC m=+58.735624115 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dcjrq" (UID: "73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9") : secret "insights-runtime-extractor-tls" not found Jul 28 16:36:41.942018 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:36:41.941888 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/edd02d28-85fb-4cc3-b755-6fec6ccb4425-registry-tls podName:edd02d28-85fb-4cc3-b755-6fec6ccb4425 nodeName:}" failed. No retries permitted until 2026-07-28 16:36:57.941880223 +0000 UTC m=+66.735676478 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/edd02d28-85fb-4cc3-b755-6fec6ccb4425-registry-tls") pod "image-registry-7cb7b7498f-8m5rd" (UID: "edd02d28-85fb-4cc3-b755-6fec6ccb4425") : secret "image-registry-tls" not found Jul 28 16:36:41.942018 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:41.941919 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dcjrq\" (UID: \"73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9\") " pod="openshift-insights/insights-runtime-extractor-dcjrq" Jul 28 16:36:41.942337 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:41.942320 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dcjrq\" (UID: \"73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9\") " pod="openshift-insights/insights-runtime-extractor-dcjrq" Jul 28 16:36:42.004206 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:42.004172 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:42.415992 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:42.415959 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:43.018629 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:43.018581 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:43.429981 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:43.429944 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:43.616107 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:43.616067 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:43.814850 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:43.814821 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:44.019873 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:44.019840 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:44.403970 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:44.403932 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:44.465403 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:44.465371 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:44.529805 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:44.529780 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:44.631079 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:44.631048 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:44.731164 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:44.731083 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:45.013709 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:45.013599 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:45.408281 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:45.408254 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:45.508063 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:45.508033 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:45.808577 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:45.808544 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:46.012715 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:46.012682 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:46.406472 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:46.406437 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:46.845483 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:46.845449 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:47.407826 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:47.407793 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:47.820803 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:47.820770 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:47.921561 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:47.921533 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:48.208484 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:48.208401 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:48.412708 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:48.412676 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:48.544222 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:48.544191 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:48.808825 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:48.808730 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:49.408688 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:49.408658 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:49.822874 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:49.822837 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:50.006893 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:50.006853 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dcjrq\" (UID: \"73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9\") " pod="openshift-insights/insights-runtime-extractor-dcjrq" Jul 28 16:36:50.009214 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:50.009182 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dcjrq\" (UID: \"73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9\") " pod="openshift-insights/insights-runtime-extractor-dcjrq" Jul 28 16:36:50.018805 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:50.018772 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:50.097975 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:50.097907 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dcjrq" Jul 28 16:36:50.222902 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:50.222840 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dcjrq"] Jul 28 16:36:50.420917 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:50.420829 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:50.973803 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:50.973680 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dcjrq" event={"ID":"73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9","Type":"ContainerStarted","Data":"5c61552bdacd31a3bbba1dce88732299d9e5d84f65663dc0fdc4c5ba852ec8f8"} Jul 28 16:36:51.013417 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:51.013341 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:51.209472 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:51.209436 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:51.414450 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:51.414374 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:53.892984 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:53.892957 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vjvs7" Jul 28 16:36:55.991934 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:55.991889 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dcjrq" event={"ID":"73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9","Type":"ContainerStarted","Data":"7fdc097c391dec8820a71dd2b98e0d8e8141355ed9a1d6357e38e3151139137f"} Jul 28 16:36:57.469185 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:57.469148 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6bf1d484-4b82-487c-bcf1-be189dabfd24-original-pull-secret\") pod \"global-pull-secret-syncer-fdgv8\" (UID: \"6bf1d484-4b82-487c-bcf1-be189dabfd24\") " pod="kube-system/global-pull-secret-syncer-fdgv8" Jul 28 16:36:57.469746 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:57.469231 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da54b8f0-8ec1-4b28-a76b-037edb5bec20-metrics-certs\") pod \"network-metrics-daemon-q6dz7\" (UID: \"da54b8f0-8ec1-4b28-a76b-037edb5bec20\") " pod="openshift-multus/network-metrics-daemon-q6dz7" Jul 28 16:36:57.472388 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:57.472362 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 16:36:57.472530 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:57.472362 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 16:36:57.482159 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:57.482132 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da54b8f0-8ec1-4b28-a76b-037edb5bec20-metrics-certs\") pod \"network-metrics-daemon-q6dz7\" (UID: \"da54b8f0-8ec1-4b28-a76b-037edb5bec20\") " pod="openshift-multus/network-metrics-daemon-q6dz7" Jul 28 16:36:57.482288 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:57.482184 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6bf1d484-4b82-487c-bcf1-be189dabfd24-original-pull-secret\") pod \"global-pull-secret-syncer-fdgv8\" (UID: \"6bf1d484-4b82-487c-bcf1-be189dabfd24\") " pod="kube-system/global-pull-secret-syncer-fdgv8" Jul 28 16:36:57.570510 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:57.570468 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xftt8\" (UniqueName: \"kubernetes.io/projected/45e07f9b-6993-4b7d-bf17-197b21c25a4b-kube-api-access-xftt8\") pod \"network-check-target-wq5zz\" (UID: \"45e07f9b-6993-4b7d-bf17-197b21c25a4b\") " pod="openshift-network-diagnostics/network-check-target-wq5zz" Jul 28 16:36:57.573625 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:57.573588 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 16:36:57.583828 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:57.583799 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 16:36:57.593809 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:57.593783 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xftt8\" (UniqueName: \"kubernetes.io/projected/45e07f9b-6993-4b7d-bf17-197b21c25a4b-kube-api-access-xftt8\") pod \"network-check-target-wq5zz\" (UID: \"45e07f9b-6993-4b7d-bf17-197b21c25a4b\") " pod="openshift-network-diagnostics/network-check-target-wq5zz" Jul 28 16:36:57.739873 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:57.739789 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nw5rm\"" Jul 28 16:36:57.745662 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:57.745635 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9n9cd\"" Jul 28 16:36:57.747705 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:57.747682 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6dz7" Jul 28 16:36:57.748891 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:57.748867 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdgv8" Jul 28 16:36:57.754017 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:57.753994 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wq5zz" Jul 28 16:36:57.974302 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:57.974268 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbe94e0b-c8db-4021-bcaa-6667f1fa992a-metrics-tls\") pod \"dns-default-gklwd\" (UID: \"cbe94e0b-c8db-4021-bcaa-6667f1fa992a\") " pod="openshift-dns/dns-default-gklwd" Jul 28 16:36:57.974470 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:57.974307 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/edd02d28-85fb-4cc3-b755-6fec6ccb4425-registry-tls\") pod \"image-registry-7cb7b7498f-8m5rd\" (UID: \"edd02d28-85fb-4cc3-b755-6fec6ccb4425\") " pod="openshift-image-registry/image-registry-7cb7b7498f-8m5rd" Jul 28 16:36:57.976917 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:57.976893 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbe94e0b-c8db-4021-bcaa-6667f1fa992a-metrics-tls\") pod \"dns-default-gklwd\" (UID: \"cbe94e0b-c8db-4021-bcaa-6667f1fa992a\") " pod="openshift-dns/dns-default-gklwd" Jul 28 16:36:57.977029 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:57.976930 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/edd02d28-85fb-4cc3-b755-6fec6ccb4425-registry-tls\") pod \"image-registry-7cb7b7498f-8m5rd\" (UID: \"edd02d28-85fb-4cc3-b755-6fec6ccb4425\") " pod="openshift-image-registry/image-registry-7cb7b7498f-8m5rd" Jul 28 16:36:58.228043 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:58.228014 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rnw5h\"" Jul 28 16:36:58.235286 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:58.235259 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cb7b7498f-8m5rd" Jul 28 16:36:58.242170 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:58.242146 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2sch7\"" Jul 28 16:36:58.249580 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:58.249559 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gklwd" Jul 28 16:36:59.238009 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:59.237964 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-q6dz7"] Jul 28 16:36:59.241679 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:36:59.241421 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda54b8f0_8ec1_4b28_a76b_037edb5bec20.slice/crio-13090ce884f4e23f997bbc6e16b86934bcc6922755b77c45aa5b36bca7075b8a WatchSource:0}: Error finding container 13090ce884f4e23f997bbc6e16b86934bcc6922755b77c45aa5b36bca7075b8a: Status 404 returned error can't find the container with id 13090ce884f4e23f997bbc6e16b86934bcc6922755b77c45aa5b36bca7075b8a Jul 28 16:36:59.291759 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:59.291726 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7cb7b7498f-8m5rd"] Jul 28 16:36:59.387683 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:36:59.387595 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedd02d28_85fb_4cc3_b755_6fec6ccb4425.slice/crio-1efcc5462d671e5e2a1edabe7efcae424b4469b68377f658cb98d5c2bd6a7612 WatchSource:0}: Error finding container 1efcc5462d671e5e2a1edabe7efcae424b4469b68377f658cb98d5c2bd6a7612: Status 404 returned error can't find the container with id 1efcc5462d671e5e2a1edabe7efcae424b4469b68377f658cb98d5c2bd6a7612 Jul 28 16:36:59.457957 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:59.457929 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wq5zz"] Jul 28 16:36:59.460763 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:36:59.460734 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45e07f9b_6993_4b7d_bf17_197b21c25a4b.slice/crio-5ddedbcdfb3881390b05342c01e2c2596c7c316812afd931b96695f5742f9b9a WatchSource:0}: Error finding container 5ddedbcdfb3881390b05342c01e2c2596c7c316812afd931b96695f5742f9b9a: Status 404 returned error can't find the container with id 5ddedbcdfb3881390b05342c01e2c2596c7c316812afd931b96695f5742f9b9a Jul 28 16:36:59.461751 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:59.461731 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fdgv8"] Jul 28 16:36:59.465023 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:59.465001 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gklwd"] Jul 28 16:36:59.469130 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:36:59.469101 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbe94e0b_c8db_4021_bcaa_6667f1fa992a.slice/crio-d0dcb30953781dcc42427e18d84ac2d3db1e8b63edcc9c6b4a3fcc8e56831cd8 WatchSource:0}: Error finding container d0dcb30953781dcc42427e18d84ac2d3db1e8b63edcc9c6b4a3fcc8e56831cd8: Status 404 returned error can't find the container with id d0dcb30953781dcc42427e18d84ac2d3db1e8b63edcc9c6b4a3fcc8e56831cd8 Jul 28 16:36:59.534463 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:59.534418 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:36:59.634803 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:36:59.634768 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:00.008027 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:00.007982 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dcjrq" event={"ID":"73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9","Type":"ContainerStarted","Data":"dbf1a9f70eb5ffc9b4bbe169d970f262444d22044c8edfef360d15c6778cafcf"} Jul 28 16:37:00.011125 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:00.011053 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gklwd" event={"ID":"cbe94e0b-c8db-4021-bcaa-6667f1fa992a","Type":"ContainerStarted","Data":"d0dcb30953781dcc42427e18d84ac2d3db1e8b63edcc9c6b4a3fcc8e56831cd8"} Jul 28 16:37:00.012790 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:00.012760 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fdgv8" event={"ID":"6bf1d484-4b82-487c-bcf1-be189dabfd24","Type":"ContainerStarted","Data":"13573a7269776c3669009ec77b8e2bc27b49d43771a0c94623f8bcff3bcd191d"} Jul 28 16:37:00.015549 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:00.014985 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7cb7b7498f-8m5rd" event={"ID":"edd02d28-85fb-4cc3-b755-6fec6ccb4425","Type":"ContainerStarted","Data":"99fa9baf041a2c253e72273469798174935442ac84e4092654fca6ef061f45f2"} Jul 28 16:37:00.015549 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:00.015030 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7cb7b7498f-8m5rd" event={"ID":"edd02d28-85fb-4cc3-b755-6fec6ccb4425","Type":"ContainerStarted","Data":"1efcc5462d671e5e2a1edabe7efcae424b4469b68377f658cb98d5c2bd6a7612"} Jul 28 16:37:00.015549 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:00.015188 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7cb7b7498f-8m5rd" Jul 28 16:37:00.017091 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:00.017018 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q6dz7" event={"ID":"da54b8f0-8ec1-4b28-a76b-037edb5bec20","Type":"ContainerStarted","Data":"13090ce884f4e23f997bbc6e16b86934bcc6922755b77c45aa5b36bca7075b8a"} Jul 28 16:37:00.019470 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:00.019413 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wq5zz" event={"ID":"45e07f9b-6993-4b7d-bf17-197b21c25a4b","Type":"ContainerStarted","Data":"5ddedbcdfb3881390b05342c01e2c2596c7c316812afd931b96695f5742f9b9a"} Jul 28 16:37:00.040817 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:00.040113 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7cb7b7498f-8m5rd" podStartSLOduration=50.040089605 podStartE2EDuration="50.040089605s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:36:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:37:00.038564144 +0000 UTC m=+68.832360421" watchObservedRunningTime="2026-07-28 16:37:00.040089605 +0000 UTC m=+68.833885883" Jul 28 16:37:00.288009 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:00.287978 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-789fbdd784-wqhln"] Jul 28 16:37:00.307019 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:00.306148 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6769c5c959-vvrbb"] Jul 28 16:37:00.307191 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:00.307163 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-789fbdd784-wqhln" Jul 28 16:37:00.311018 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:00.310982 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 28 16:37:00.311816 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:00.311510 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 28 16:37:00.311816 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:00.311663 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 28 16:37:00.323386 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:00.320915 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 28 16:37:00.329149 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:00.328208 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7cb7b7498f-8m5rd"] Jul 28 16:37:00.329149 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:00.328263 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6769c5c959-vvrbb"] Jul 28 16:37:00.329149 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:00.328390 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6769c5c959-vvrbb" Jul 28 16:37:00.329369 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:00.329314 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-789fbdd784-wqhln"] Jul 28 16:37:00.331634 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:00.331593 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 28 16:37:00.331731 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:00.331683 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 28 16:37:00.332194 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:00.331941 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 28 16:37:00.332194 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:00.331961 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 28 16:37:00.392187 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:00.392008 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c36fb6ca-7af1-4855-8a43-b5f6455a9eee-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6769c5c959-vvrbb\" (UID: \"c36fb6ca-7af1-4855-8a43-b5f6455a9eee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6769c5c959-vvrbb" Jul 28 16:37:00.392187 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:00.392079 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7510bcbd-af72-4ac4-a56c-a21c2474cc42-tmp\") pod \"klusterlet-addon-workmgr-789fbdd784-wqhln\" (UID: \"7510bcbd-af72-4ac4-a56c-a21c2474cc42\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-789fbdd784-wqhln" Jul 28 16:37:00.392187 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:00.392109 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7510bcbd-af72-4ac4-a56c-a21c2474cc42-klusterlet-config\") pod \"klusterlet-addon-workmgr-789fbdd784-wqhln\" (UID: \"7510bcbd-af72-4ac4-a56c-a21c2474cc42\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-789fbdd784-wqhln" Jul 28 16:37:00.392187 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:00.392144 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c36fb6ca-7af1-4855-8a43-b5f6455a9eee-hub\") pod \"cluster-proxy-proxy-agent-6769c5c959-vvrbb\" (UID: \"c36fb6ca-7af1-4855-8a43-b5f6455a9eee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6769c5c959-vvrbb" Jul 28 16:37:00.392517 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:00.392209 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c36fb6ca-7af1-4855-8a43-b5f6455a9eee-ca\") pod \"cluster-proxy-proxy-agent-6769c5c959-vvrbb\" (UID: \"c36fb6ca-7af1-4855-8a43-b5f6455a9eee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6769c5c959-vvrbb" Jul 28 16:37:00.392517 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:00.392335 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wh68v\" (UniqueName: \"kubernetes.io/projected/7510bcbd-af72-4ac4-a56c-a21c2474cc42-kube-api-access-wh68v\") pod \"klusterlet-addon-workmgr-789fbdd784-wqhln\" (UID: \"7510bcbd-af72-4ac4-a56c-a21c2474cc42\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-789fbdd784-wqhln" Jul 28 16:37:00.392517 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:00.392367 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c36fb6ca-7af1-4855-8a43-b5f6455a9eee-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6769c5c959-vvrbb\" (UID: \"c36fb6ca-7af1-4855-8a43-b5f6455a9eee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6769c5c959-vvrbb" Jul 28 16:37:00.392517 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:00.392402 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c36fb6ca-7af1-4855-8a43-b5f6455a9eee-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6769c5c959-vvrbb\" (UID: \"c36fb6ca-7af1-4855-8a43-b5f6455a9eee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6769c5c959-vvrbb" Jul 28 16:37:00.392517 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:00.392431 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6jsg\" (UniqueName: \"kubernetes.io/projected/c36fb6ca-7af1-4855-8a43-b5f6455a9eee-kube-api-access-d6jsg\") pod \"cluster-proxy-proxy-agent-6769c5c959-vvrbb\" (UID: \"c36fb6ca-7af1-4855-8a43-b5f6455a9eee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6769c5c959-vvrbb" Jul 28 16:37:00.435628 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:00.435586 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:00.493184 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:00.493097 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh68v\" (UniqueName: \"kubernetes.io/projected/7510bcbd-af72-4ac4-a56c-a21c2474cc42-kube-api-access-wh68v\") pod \"klusterlet-addon-workmgr-789fbdd784-wqhln\" (UID: \"7510bcbd-af72-4ac4-a56c-a21c2474cc42\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-789fbdd784-wqhln" Jul 28 16:37:00.493184 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:00.493142 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c36fb6ca-7af1-4855-8a43-b5f6455a9eee-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6769c5c959-vvrbb\" (UID: \"c36fb6ca-7af1-4855-8a43-b5f6455a9eee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6769c5c959-vvrbb" Jul 28 16:37:00.493642 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:00.493482 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c36fb6ca-7af1-4855-8a43-b5f6455a9eee-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6769c5c959-vvrbb\" (UID: \"c36fb6ca-7af1-4855-8a43-b5f6455a9eee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6769c5c959-vvrbb" Jul 28 16:37:00.493642 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:00.493522 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6jsg\" (UniqueName: \"kubernetes.io/projected/c36fb6ca-7af1-4855-8a43-b5f6455a9eee-kube-api-access-d6jsg\") pod \"cluster-proxy-proxy-agent-6769c5c959-vvrbb\" (UID: \"c36fb6ca-7af1-4855-8a43-b5f6455a9eee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6769c5c959-vvrbb" Jul 28 16:37:00.493642 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:00.493573 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c36fb6ca-7af1-4855-8a43-b5f6455a9eee-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6769c5c959-vvrbb\" (UID: \"c36fb6ca-7af1-4855-8a43-b5f6455a9eee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6769c5c959-vvrbb" Jul 28 16:37:00.493926 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:00.493896 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7510bcbd-af72-4ac4-a56c-a21c2474cc42-tmp\") pod \"klusterlet-addon-workmgr-789fbdd784-wqhln\" (UID: \"7510bcbd-af72-4ac4-a56c-a21c2474cc42\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-789fbdd784-wqhln" Jul 28 16:37:00.494062 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:00.493933 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7510bcbd-af72-4ac4-a56c-a21c2474cc42-klusterlet-config\") pod \"klusterlet-addon-workmgr-789fbdd784-wqhln\" (UID: \"7510bcbd-af72-4ac4-a56c-a21c2474cc42\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-789fbdd784-wqhln" Jul 28 16:37:00.494062 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:00.493975 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c36fb6ca-7af1-4855-8a43-b5f6455a9eee-hub\") pod \"cluster-proxy-proxy-agent-6769c5c959-vvrbb\" (UID: \"c36fb6ca-7af1-4855-8a43-b5f6455a9eee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6769c5c959-vvrbb" Jul 28 16:37:00.494062 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:00.494012 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c36fb6ca-7af1-4855-8a43-b5f6455a9eee-ca\") pod \"cluster-proxy-proxy-agent-6769c5c959-vvrbb\" (UID: \"c36fb6ca-7af1-4855-8a43-b5f6455a9eee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6769c5c959-vvrbb" Jul 28 16:37:00.494764 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:00.494393 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7510bcbd-af72-4ac4-a56c-a21c2474cc42-tmp\") pod \"klusterlet-addon-workmgr-789fbdd784-wqhln\" (UID: \"7510bcbd-af72-4ac4-a56c-a21c2474cc42\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-789fbdd784-wqhln" Jul 28 16:37:00.495306 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:00.495279 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c36fb6ca-7af1-4855-8a43-b5f6455a9eee-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6769c5c959-vvrbb\" (UID: \"c36fb6ca-7af1-4855-8a43-b5f6455a9eee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6769c5c959-vvrbb" Jul 28 16:37:00.497727 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:00.497684 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c36fb6ca-7af1-4855-8a43-b5f6455a9eee-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6769c5c959-vvrbb\" (UID: \"c36fb6ca-7af1-4855-8a43-b5f6455a9eee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6769c5c959-vvrbb" Jul 28 16:37:00.498014 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:00.497991 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7510bcbd-af72-4ac4-a56c-a21c2474cc42-klusterlet-config\") pod \"klusterlet-addon-workmgr-789fbdd784-wqhln\" (UID: \"7510bcbd-af72-4ac4-a56c-a21c2474cc42\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-789fbdd784-wqhln" Jul 28 16:37:00.500555 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:00.500507 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c36fb6ca-7af1-4855-8a43-b5f6455a9eee-hub\") pod \"cluster-proxy-proxy-agent-6769c5c959-vvrbb\" (UID: \"c36fb6ca-7af1-4855-8a43-b5f6455a9eee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6769c5c959-vvrbb" Jul 28 16:37:00.501022 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:00.500982 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c36fb6ca-7af1-4855-8a43-b5f6455a9eee-ca\") pod \"cluster-proxy-proxy-agent-6769c5c959-vvrbb\" (UID: \"c36fb6ca-7af1-4855-8a43-b5f6455a9eee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6769c5c959-vvrbb" Jul 28 16:37:00.503251 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:00.503205 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wh68v\" (UniqueName: \"kubernetes.io/projected/7510bcbd-af72-4ac4-a56c-a21c2474cc42-kube-api-access-wh68v\") pod \"klusterlet-addon-workmgr-789fbdd784-wqhln\" (UID: \"7510bcbd-af72-4ac4-a56c-a21c2474cc42\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-789fbdd784-wqhln" Jul 28 16:37:00.503988 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:00.503948 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c36fb6ca-7af1-4855-8a43-b5f6455a9eee-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6769c5c959-vvrbb\" (UID: \"c36fb6ca-7af1-4855-8a43-b5f6455a9eee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6769c5c959-vvrbb" Jul 28 16:37:00.508969 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:00.508940 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6jsg\" (UniqueName: \"kubernetes.io/projected/c36fb6ca-7af1-4855-8a43-b5f6455a9eee-kube-api-access-d6jsg\") pod \"cluster-proxy-proxy-agent-6769c5c959-vvrbb\" (UID: \"c36fb6ca-7af1-4855-8a43-b5f6455a9eee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6769c5c959-vvrbb" Jul 28 16:37:00.529853 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:00.529721 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:00.631192 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:00.630785 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:00.631192 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:00.630955 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-789fbdd784-wqhln" Jul 28 16:37:00.649184 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:00.649153 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6769c5c959-vvrbb" Jul 28 16:37:00.868240 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:00.868100 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-789fbdd784-wqhln"] Jul 28 16:37:00.872863 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:37:00.872815 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7510bcbd_af72_4ac4_a56c_a21c2474cc42.slice/crio-50e90c8ba43e26195028d6bc9ab6452c759dc2012eb8de4559526e2d5267156d WatchSource:0}: Error finding container 50e90c8ba43e26195028d6bc9ab6452c759dc2012eb8de4559526e2d5267156d: Status 404 returned error can't find the container with id 50e90c8ba43e26195028d6bc9ab6452c759dc2012eb8de4559526e2d5267156d Jul 28 16:37:00.888890 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:00.888728 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6769c5c959-vvrbb"] Jul 28 16:37:00.896673 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:37:00.896641 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc36fb6ca_7af1_4855_8a43_b5f6455a9eee.slice/crio-8841fb2a9c511cd735bab9f7ffa09c113b437f1e59d4588a07c30541cc82b882 WatchSource:0}: Error finding container 8841fb2a9c511cd735bab9f7ffa09c113b437f1e59d4588a07c30541cc82b882: Status 404 returned error can't find the container with id 8841fb2a9c511cd735bab9f7ffa09c113b437f1e59d4588a07c30541cc82b882 Jul 28 16:37:01.027558 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:01.027494 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6769c5c959-vvrbb" event={"ID":"c36fb6ca-7af1-4855-8a43-b5f6455a9eee","Type":"ContainerStarted","Data":"8841fb2a9c511cd735bab9f7ffa09c113b437f1e59d4588a07c30541cc82b882"} Jul 28 16:37:01.030668 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:01.030637 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-789fbdd784-wqhln" event={"ID":"7510bcbd-af72-4ac4-a56c-a21c2474cc42","Type":"ContainerStarted","Data":"50e90c8ba43e26195028d6bc9ab6452c759dc2012eb8de4559526e2d5267156d"} Jul 28 16:37:01.034299 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:01.034270 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q6dz7" event={"ID":"da54b8f0-8ec1-4b28-a76b-037edb5bec20","Type":"ContainerStarted","Data":"84c559e730daaf2a7730108c6832f1a99c170a61ead220fc2e78df9e955d0f8a"} Jul 28 16:37:01.034423 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:01.034322 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q6dz7" event={"ID":"da54b8f0-8ec1-4b28-a76b-037edb5bec20","Type":"ContainerStarted","Data":"bcb226dd1d04bbfa50dec235f901abdfcfd3dbf6232ef76a7d2d01cbc8515907"} Jul 28 16:37:01.537362 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:01.537291 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:01.946397 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:01.946304 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:02.004806 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:02.004769 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:02.062706 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:02.062632 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-q6dz7" podStartSLOduration=69.617224464 podStartE2EDuration="1m11.062592318s" totalImagesPullingTime="1.445367854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:35:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:37:01.054212941 +0000 UTC m=+69.848009219" watchObservedRunningTime="2026-07-28 16:37:02.062592318 +0000 UTC m=+70.856388594" Jul 28 16:37:02.848027 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:02.847947 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:02.944581 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:02.944481 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:03.047227 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:03.047157 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:03.147365 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:03.147288 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:03.388029 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:03.387920 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:03.528189 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:03.528111 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:03.586447 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:03.586402 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:04.733998 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:04.733966 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:04.791507 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:04.791479 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:04.943184 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:04.943151 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:05.335432 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:05.335400 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:05.393008 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:05.392977 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:05.857297 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:05.857253 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:05.919958 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:05.919924 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:06.340746 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:06.340714 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:06.763512 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:06.763427 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:06.820685 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:06.820648 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:09.360016 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:09.359972 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:09.493591 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:09.493550 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:09.595340 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:09.595303 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:09.695120 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:09.695030 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:09.981599 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:09.981520 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:10.085343 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:10.085307 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:10.192729 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:10.192696 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:10.291073 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:10.291045 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:10.783465 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:10.783389 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:11.023078 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:11.023046 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:11.073581 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:11.073551 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fdgv8" event={"ID":"6bf1d484-4b82-487c-bcf1-be189dabfd24","Type":"ContainerStarted","Data":"674b6d0d930ba1dab803b5593b58b676773a71c66833e5c0065fea88165dd218"} Jul 28 16:37:11.075191 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:11.075168 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-789fbdd784-wqhln" event={"ID":"7510bcbd-af72-4ac4-a56c-a21c2474cc42","Type":"ContainerStarted","Data":"d13afc50cecdb057643b45c016119b51bf1d40ec3a3fdfe0b626c121e5c04cfc"} Jul 28 16:37:11.075352 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:11.075335 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-789fbdd784-wqhln" Jul 28 16:37:11.076808 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:11.076787 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wq5zz" event={"ID":"45e07f9b-6993-4b7d-bf17-197b21c25a4b","Type":"ContainerStarted","Data":"47041a2f08040d6db67fed95c98ba2292b0e346fdc928d1cda8bafcce5505eaa"} Jul 28 16:37:11.076916 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:11.076842 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wq5zz" Jul 28 16:37:11.077511 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:11.077491 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-789fbdd784-wqhln" Jul 28 16:37:11.078964 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:11.078940 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dcjrq" event={"ID":"73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9","Type":"ContainerStarted","Data":"a041f21a1aebae5ef404eb36701fb97f5354f6684a585343f24902d273dfdfa4"} Jul 28 16:37:11.080763 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:11.080741 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gklwd" event={"ID":"cbe94e0b-c8db-4021-bcaa-6667f1fa992a","Type":"ContainerStarted","Data":"4fc8e7f2043f28eb3a70398b9d78d1f8dd997a2f8baafb5330b4cb8e3843ca02"} Jul 28 16:37:11.080862 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:11.080785 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gklwd" event={"ID":"cbe94e0b-c8db-4021-bcaa-6667f1fa992a","Type":"ContainerStarted","Data":"3447d7b6afe3dba8718a1af16882de02e62f461eab3b8c938e91d7816e7521e4"} Jul 28 16:37:11.080862 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:11.080813 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gklwd" Jul 28 16:37:11.082719 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:11.082699 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6769c5c959-vvrbb" event={"ID":"c36fb6ca-7af1-4855-8a43-b5f6455a9eee","Type":"ContainerStarted","Data":"3af83ec3ce96508120cc18b48a6bd6b0be195fa93214c47afeb8ee476c1f62ca"} Jul 28 16:37:11.082855 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:11.082726 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6769c5c959-vvrbb" event={"ID":"c36fb6ca-7af1-4855-8a43-b5f6455a9eee","Type":"ContainerStarted","Data":"75a4c963a39408b9cf5432ba14dbc27ceb25a4c400d8144783a4c779de99bce8"} Jul 28 16:37:11.082855 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:11.082737 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6769c5c959-vvrbb" event={"ID":"c36fb6ca-7af1-4855-8a43-b5f6455a9eee","Type":"ContainerStarted","Data":"95180f1a12efd1fb95456d262dda7a79d7ce640451f52d1bf44c5fc86c4a951e"} Jul 28 16:37:11.093568 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:11.093526 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fdgv8" podStartSLOduration=69.342134924 podStartE2EDuration="1m20.093499103s" totalImagesPullingTime="10.751364179s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 16:35:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:37:11.093113686 +0000 UTC m=+79.886909962" watchObservedRunningTime="2026-07-28 16:37:11.093499103 +0000 UTC m=+79.887295375" Jul 28 16:37:11.097670 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:11.097635 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:11.109435 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:11.109397 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wq5zz" podStartSLOduration=69.35483173 podStartE2EDuration="1m20.109384672s" totalImagesPullingTime="10.754552942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:35:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:37:11.109319116 +0000 UTC m=+79.903115395" watchObservedRunningTime="2026-07-28 16:37:11.109384672 +0000 UTC m=+79.903180948" Jul 28 16:37:11.132247 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:11.132204 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-gklwd" podStartSLOduration=35.583257364 podStartE2EDuration="45.132189923s" totalImagesPullingTime="9.548932559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:36:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:37:11.13125589 +0000 UTC m=+79.925052167" watchObservedRunningTime="2026-07-28 16:37:11.132189923 +0000 UTC m=+79.925986199" Jul 28 16:37:11.149875 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:11.149829 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-789fbdd784-wqhln" podStartSLOduration=1.7793614679999998 podStartE2EDuration="11.149814046s" totalImagesPullingTime="9.370452578s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:37:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:37:11.148450529 +0000 UTC m=+79.942246806" watchObservedRunningTime="2026-07-28 16:37:11.149814046 +0000 UTC m=+79.943610321" Jul 28 16:37:11.192408 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:11.192355 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-dcjrq" podStartSLOduration=17.35707058 podStartE2EDuration="37.192334929s" totalImagesPullingTime="19.835264349s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 16:36:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:37:11.191265818 +0000 UTC m=+79.985062094" watchObservedRunningTime="2026-07-28 16:37:11.192334929 +0000 UTC m=+79.986131205" Jul 28 16:37:11.193756 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:11.193711 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6769c5c959-vvrbb" podStartSLOduration=1.854509528 podStartE2EDuration="11.193698521s" totalImagesPullingTime="9.339188993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:37:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:37:11.170444121 +0000 UTC m=+79.964240398" watchObservedRunningTime="2026-07-28 16:37:11.193698521 +0000 UTC m=+79.987494798" Jul 28 16:37:11.392818 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:11.392726 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:11.729062 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:11.728957 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:12.249398 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:12.249362 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:14.223837 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:14.223674 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:14.390682 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:14.390623 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:14.488969 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:14.488858 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9rmk2"] Jul 28 16:37:14.497392 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:14.497360 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9rmk2" Jul 28 16:37:14.500945 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:14.500921 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 28 16:37:14.501090 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:14.500965 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 28 16:37:14.501148 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:14.501091 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 28 16:37:14.501148 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:14.501118 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 28 16:37:14.502288 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:14.502268 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7fl9j\"" Jul 28 16:37:14.502411 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:14.502314 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 28 16:37:14.502411 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:14.502343 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 28 16:37:14.507227 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:14.507205 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:14.599335 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:14.599299 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:14.616331 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:14.616297 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3a7d81a8-12af-406b-9fcf-5510d483ae61-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9rmk2\" (UID: \"3a7d81a8-12af-406b-9fcf-5510d483ae61\") " pod="openshift-monitoring/node-exporter-9rmk2" Jul 28 16:37:14.616505 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:14.616395 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3a7d81a8-12af-406b-9fcf-5510d483ae61-node-exporter-wtmp\") pod \"node-exporter-9rmk2\" (UID: \"3a7d81a8-12af-406b-9fcf-5510d483ae61\") " pod="openshift-monitoring/node-exporter-9rmk2" Jul 28 16:37:14.616505 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:14.616434 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3a7d81a8-12af-406b-9fcf-5510d483ae61-node-exporter-textfile\") pod \"node-exporter-9rmk2\" (UID: \"3a7d81a8-12af-406b-9fcf-5510d483ae61\") " pod="openshift-monitoring/node-exporter-9rmk2" Jul 28 16:37:14.616505 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:14.616469 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3a7d81a8-12af-406b-9fcf-5510d483ae61-node-exporter-tls\") pod \"node-exporter-9rmk2\" (UID: \"3a7d81a8-12af-406b-9fcf-5510d483ae61\") " pod="openshift-monitoring/node-exporter-9rmk2" Jul 28 16:37:14.616505 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:14.616494 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a7d81a8-12af-406b-9fcf-5510d483ae61-metrics-client-ca\") pod \"node-exporter-9rmk2\" (UID: \"3a7d81a8-12af-406b-9fcf-5510d483ae61\") " pod="openshift-monitoring/node-exporter-9rmk2" Jul 28 16:37:14.616673 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:14.616517 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a7d81a8-12af-406b-9fcf-5510d483ae61-sys\") pod \"node-exporter-9rmk2\" (UID: \"3a7d81a8-12af-406b-9fcf-5510d483ae61\") " pod="openshift-monitoring/node-exporter-9rmk2" Jul 28 16:37:14.616673 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:14.616625 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3a7d81a8-12af-406b-9fcf-5510d483ae61-node-exporter-accelerators-collector-config\") pod \"node-exporter-9rmk2\" (UID: \"3a7d81a8-12af-406b-9fcf-5510d483ae61\") " pod="openshift-monitoring/node-exporter-9rmk2" Jul 28 16:37:14.616673 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:14.616655 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xq7rj\" (UniqueName: \"kubernetes.io/projected/3a7d81a8-12af-406b-9fcf-5510d483ae61-kube-api-access-xq7rj\") pod \"node-exporter-9rmk2\" (UID: \"3a7d81a8-12af-406b-9fcf-5510d483ae61\") " pod="openshift-monitoring/node-exporter-9rmk2" Jul 28 16:37:14.616785 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:14.616678 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3a7d81a8-12af-406b-9fcf-5510d483ae61-root\") pod \"node-exporter-9rmk2\" (UID: \"3a7d81a8-12af-406b-9fcf-5510d483ae61\") " pod="openshift-monitoring/node-exporter-9rmk2" Jul 28 16:37:14.700502 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:14.700472 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:14.717647 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:14.717595 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3a7d81a8-12af-406b-9fcf-5510d483ae61-node-exporter-accelerators-collector-config\") pod \"node-exporter-9rmk2\" (UID: \"3a7d81a8-12af-406b-9fcf-5510d483ae61\") " pod="openshift-monitoring/node-exporter-9rmk2" Jul 28 16:37:14.717788 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:14.717659 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xq7rj\" (UniqueName: \"kubernetes.io/projected/3a7d81a8-12af-406b-9fcf-5510d483ae61-kube-api-access-xq7rj\") pod \"node-exporter-9rmk2\" (UID: \"3a7d81a8-12af-406b-9fcf-5510d483ae61\") " pod="openshift-monitoring/node-exporter-9rmk2" Jul 28 16:37:14.717788 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:14.717695 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3a7d81a8-12af-406b-9fcf-5510d483ae61-root\") pod \"node-exporter-9rmk2\" (UID: \"3a7d81a8-12af-406b-9fcf-5510d483ae61\") " pod="openshift-monitoring/node-exporter-9rmk2" Jul 28 16:37:14.717788 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:14.717723 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3a7d81a8-12af-406b-9fcf-5510d483ae61-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9rmk2\" (UID: \"3a7d81a8-12af-406b-9fcf-5510d483ae61\") " pod="openshift-monitoring/node-exporter-9rmk2" Jul 28 16:37:14.717788 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:14.717774 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3a7d81a8-12af-406b-9fcf-5510d483ae61-node-exporter-wtmp\") pod \"node-exporter-9rmk2\" (UID: \"3a7d81a8-12af-406b-9fcf-5510d483ae61\") " pod="openshift-monitoring/node-exporter-9rmk2" Jul 28 16:37:14.718017 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:14.717801 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3a7d81a8-12af-406b-9fcf-5510d483ae61-node-exporter-textfile\") pod \"node-exporter-9rmk2\" (UID: \"3a7d81a8-12af-406b-9fcf-5510d483ae61\") " pod="openshift-monitoring/node-exporter-9rmk2" Jul 28 16:37:14.718017 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:14.717831 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3a7d81a8-12af-406b-9fcf-5510d483ae61-node-exporter-tls\") pod \"node-exporter-9rmk2\" (UID: \"3a7d81a8-12af-406b-9fcf-5510d483ae61\") " pod="openshift-monitoring/node-exporter-9rmk2" Jul 28 16:37:14.718017 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:14.717856 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a7d81a8-12af-406b-9fcf-5510d483ae61-metrics-client-ca\") pod \"node-exporter-9rmk2\" (UID: \"3a7d81a8-12af-406b-9fcf-5510d483ae61\") " pod="openshift-monitoring/node-exporter-9rmk2" Jul 28 16:37:14.718017 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:14.717881 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a7d81a8-12af-406b-9fcf-5510d483ae61-sys\") pod \"node-exporter-9rmk2\" (UID: \"3a7d81a8-12af-406b-9fcf-5510d483ae61\") " pod="openshift-monitoring/node-exporter-9rmk2" Jul 28 16:37:14.718017 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:14.717976 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a7d81a8-12af-406b-9fcf-5510d483ae61-sys\") pod \"node-exporter-9rmk2\" (UID: \"3a7d81a8-12af-406b-9fcf-5510d483ae61\") " pod="openshift-monitoring/node-exporter-9rmk2" Jul 28 16:37:14.718259 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:37:14.718085 2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 28 16:37:14.718259 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:14.718095 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3a7d81a8-12af-406b-9fcf-5510d483ae61-node-exporter-wtmp\") pod \"node-exporter-9rmk2\" (UID: \"3a7d81a8-12af-406b-9fcf-5510d483ae61\") " pod="openshift-monitoring/node-exporter-9rmk2" Jul 28 16:37:14.718259 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:37:14.718158 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a7d81a8-12af-406b-9fcf-5510d483ae61-node-exporter-tls podName:3a7d81a8-12af-406b-9fcf-5510d483ae61 nodeName:}" failed. No retries permitted until 2026-07-28 16:37:15.21813897 +0000 UTC m=+84.011935227 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/3a7d81a8-12af-406b-9fcf-5510d483ae61-node-exporter-tls") pod "node-exporter-9rmk2" (UID: "3a7d81a8-12af-406b-9fcf-5510d483ae61") : secret "node-exporter-tls" not found Jul 28 16:37:14.718259 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:14.718221 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3a7d81a8-12af-406b-9fcf-5510d483ae61-node-exporter-accelerators-collector-config\") pod \"node-exporter-9rmk2\" (UID: \"3a7d81a8-12af-406b-9fcf-5510d483ae61\") " pod="openshift-monitoring/node-exporter-9rmk2" Jul 28 16:37:14.718455 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:14.718413 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3a7d81a8-12af-406b-9fcf-5510d483ae61-node-exporter-textfile\") pod \"node-exporter-9rmk2\" (UID: \"3a7d81a8-12af-406b-9fcf-5510d483ae61\") " pod="openshift-monitoring/node-exporter-9rmk2" Jul 28 16:37:14.718540 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:14.718469 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3a7d81a8-12af-406b-9fcf-5510d483ae61-root\") pod \"node-exporter-9rmk2\" (UID: \"3a7d81a8-12af-406b-9fcf-5510d483ae61\") " pod="openshift-monitoring/node-exporter-9rmk2" Jul 28 16:37:14.718643 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:14.718603 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a7d81a8-12af-406b-9fcf-5510d483ae61-metrics-client-ca\") pod \"node-exporter-9rmk2\" (UID: \"3a7d81a8-12af-406b-9fcf-5510d483ae61\") " pod="openshift-monitoring/node-exporter-9rmk2" Jul 28 16:37:14.720383 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:14.720362 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3a7d81a8-12af-406b-9fcf-5510d483ae61-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9rmk2\" (UID: \"3a7d81a8-12af-406b-9fcf-5510d483ae61\") " pod="openshift-monitoring/node-exporter-9rmk2" Jul 28 16:37:14.726730 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:14.726707 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xq7rj\" (UniqueName: \"kubernetes.io/projected/3a7d81a8-12af-406b-9fcf-5510d483ae61-kube-api-access-xq7rj\") pod \"node-exporter-9rmk2\" (UID: \"3a7d81a8-12af-406b-9fcf-5510d483ae61\") " pod="openshift-monitoring/node-exporter-9rmk2" Jul 28 16:37:14.792727 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:14.792692 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:14.924841 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:14.924805 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:15.021978 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:15.021939 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:15.222069 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:15.221989 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3a7d81a8-12af-406b-9fcf-5510d483ae61-node-exporter-tls\") pod \"node-exporter-9rmk2\" (UID: \"3a7d81a8-12af-406b-9fcf-5510d483ae61\") " pod="openshift-monitoring/node-exporter-9rmk2" Jul 28 16:37:15.224367 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:15.224332 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3a7d81a8-12af-406b-9fcf-5510d483ae61-node-exporter-tls\") pod \"node-exporter-9rmk2\" (UID: \"3a7d81a8-12af-406b-9fcf-5510d483ae61\") " pod="openshift-monitoring/node-exporter-9rmk2" Jul 28 16:37:15.407819 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:15.407787 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9rmk2" Jul 28 16:37:15.419874 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:37:15.419840 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a7d81a8_12af_406b_9fcf_5510d483ae61.slice/crio-0904b7b089e6eeaecd64d4bcfb45d6449e7e62f7c7623d92eb1a2b82d18eccd7 WatchSource:0}: Error finding container 0904b7b089e6eeaecd64d4bcfb45d6449e7e62f7c7623d92eb1a2b82d18eccd7: Status 404 returned error can't find the container with id 0904b7b089e6eeaecd64d4bcfb45d6449e7e62f7c7623d92eb1a2b82d18eccd7 Jul 28 16:37:15.449182 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:15.449143 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:15.534622 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:15.534586 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:15.821882 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:15.821801 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:16.020317 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:16.020286 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:16.093391 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:16.093304 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:16.102349 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:16.102322 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9rmk2" event={"ID":"3a7d81a8-12af-406b-9fcf-5510d483ae61","Type":"ContainerStarted","Data":"0904b7b089e6eeaecd64d4bcfb45d6449e7e62f7c7623d92eb1a2b82d18eccd7"} Jul 28 16:37:17.107760 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:17.107721 2563 generic.go:356] "Generic (PLEG): container finished" podID="3a7d81a8-12af-406b-9fcf-5510d483ae61" containerID="09700c505b309a8ba6d3146a3b7a5bfe7abd4b80e0e4b6c9a2c6d0abfa5c7804" exitCode=0 Jul 28 16:37:17.107760 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:17.107767 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9rmk2" event={"ID":"3a7d81a8-12af-406b-9fcf-5510d483ae61","Type":"ContainerDied","Data":"09700c505b309a8ba6d3146a3b7a5bfe7abd4b80e0e4b6c9a2c6d0abfa5c7804"} Jul 28 16:37:17.453946 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:17.453852 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:17.536823 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:17.536792 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:17.680981 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:17.680945 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:18.112718 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:18.112683 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9rmk2" event={"ID":"3a7d81a8-12af-406b-9fcf-5510d483ae61","Type":"ContainerStarted","Data":"0d29242c4228631d42a1848132d1600c9183e49193bd75771315607b21dbb501"} Jul 28 16:37:18.113092 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:18.112733 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9rmk2" event={"ID":"3a7d81a8-12af-406b-9fcf-5510d483ae61","Type":"ContainerStarted","Data":"9b8f9b046bda646e21ed180b8454c2be44fb0ffc2064278abb3102d9ca45d6ef"} Jul 28 16:37:18.137181 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:18.137131 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9rmk2" podStartSLOduration=3.2590026180000002 podStartE2EDuration="4.137115709s" totalImagesPullingTime="814.382459ms" totalInitContainerRuntime="63.730632ms" isStatefulPod=true podCreationTimestamp="2026-07-28 16:37:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:37:18.135896405 +0000 UTC m=+86.929692681" watchObservedRunningTime="2026-07-28 16:37:18.137115709 +0000 UTC m=+86.930911984" Jul 28 16:37:18.178204 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:18.178158 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:18.278305 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:18.278271 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:18.424585 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:18.424507 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:18.501384 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:18.501355 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:19.230227 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:19.230194 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:19.330489 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:19.330463 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:19.431537 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:19.431506 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:20.760829 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:20.760794 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:21.089210 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:21.089181 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gklwd" Jul 28 16:37:21.293814 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:21.293780 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:21.394057 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:21.393970 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:21.494253 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:21.494220 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:22.044762 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:22.044733 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7cb7b7498f-8m5rd" Jul 28 16:37:24.518101 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:24.518067 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:24.582654 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:24.582621 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:24.643087 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:24.643058 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:24.706661 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:24.706635 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:27.059409 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:27.059366 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7cb7b7498f-8m5rd" podUID="edd02d28-85fb-4cc3-b755-6fec6ccb4425" containerName="registry" containerID="cri-o://99fa9baf041a2c253e72273469798174935442ac84e4092654fca6ef061f45f2" gracePeriod=30 Jul 28 16:37:27.148490 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:27.148453 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:27.240893 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:27.240865 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:27.301954 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:27.301923 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cb7b7498f-8m5rd" Jul 28 16:37:27.415866 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:27.415782 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/edd02d28-85fb-4cc3-b755-6fec6ccb4425-trusted-ca\") pod \"edd02d28-85fb-4cc3-b755-6fec6ccb4425\" (UID: \"edd02d28-85fb-4cc3-b755-6fec6ccb4425\") " Jul 28 16:37:27.415866 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:27.415837 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/edd02d28-85fb-4cc3-b755-6fec6ccb4425-image-registry-private-configuration\") pod \"edd02d28-85fb-4cc3-b755-6fec6ccb4425\" (UID: \"edd02d28-85fb-4cc3-b755-6fec6ccb4425\") " Jul 28 16:37:27.416085 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:27.415874 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/edd02d28-85fb-4cc3-b755-6fec6ccb4425-registry-tls\") pod \"edd02d28-85fb-4cc3-b755-6fec6ccb4425\" (UID: \"edd02d28-85fb-4cc3-b755-6fec6ccb4425\") " Jul 28 16:37:27.416085 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:27.415916 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c4zpj\" (UniqueName: \"kubernetes.io/projected/edd02d28-85fb-4cc3-b755-6fec6ccb4425-kube-api-access-c4zpj\") pod \"edd02d28-85fb-4cc3-b755-6fec6ccb4425\" (UID: \"edd02d28-85fb-4cc3-b755-6fec6ccb4425\") " Jul 28 16:37:27.416085 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:27.415943 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/edd02d28-85fb-4cc3-b755-6fec6ccb4425-installation-pull-secrets\") pod \"edd02d28-85fb-4cc3-b755-6fec6ccb4425\" (UID: \"edd02d28-85fb-4cc3-b755-6fec6ccb4425\") " Jul 28 16:37:27.416085 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:27.415959 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/edd02d28-85fb-4cc3-b755-6fec6ccb4425-registry-certificates\") pod \"edd02d28-85fb-4cc3-b755-6fec6ccb4425\" (UID: \"edd02d28-85fb-4cc3-b755-6fec6ccb4425\") " Jul 28 16:37:27.416085 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:27.415986 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/edd02d28-85fb-4cc3-b755-6fec6ccb4425-ca-trust-extracted\") pod \"edd02d28-85fb-4cc3-b755-6fec6ccb4425\" (UID: \"edd02d28-85fb-4cc3-b755-6fec6ccb4425\") " Jul 28 16:37:27.416085 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:27.416029 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/edd02d28-85fb-4cc3-b755-6fec6ccb4425-bound-sa-token\") pod \"edd02d28-85fb-4cc3-b755-6fec6ccb4425\" (UID: \"edd02d28-85fb-4cc3-b755-6fec6ccb4425\") " Jul 28 16:37:27.416410 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:27.416380 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/edd02d28-85fb-4cc3-b755-6fec6ccb4425-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "edd02d28-85fb-4cc3-b755-6fec6ccb4425" (UID: "edd02d28-85fb-4cc3-b755-6fec6ccb4425"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 16:37:27.416571 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:27.416527 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/edd02d28-85fb-4cc3-b755-6fec6ccb4425-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "edd02d28-85fb-4cc3-b755-6fec6ccb4425" (UID: "edd02d28-85fb-4cc3-b755-6fec6ccb4425"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 16:37:27.418966 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:27.418935 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edd02d28-85fb-4cc3-b755-6fec6ccb4425-kube-api-access-c4zpj" (OuterVolumeSpecName: "kube-api-access-c4zpj") pod "edd02d28-85fb-4cc3-b755-6fec6ccb4425" (UID: "edd02d28-85fb-4cc3-b755-6fec6ccb4425"). InnerVolumeSpecName "kube-api-access-c4zpj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 16:37:27.418966 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:27.418957 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edd02d28-85fb-4cc3-b755-6fec6ccb4425-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "edd02d28-85fb-4cc3-b755-6fec6ccb4425" (UID: "edd02d28-85fb-4cc3-b755-6fec6ccb4425"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 16:37:27.419133 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:27.419037 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edd02d28-85fb-4cc3-b755-6fec6ccb4425-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "edd02d28-85fb-4cc3-b755-6fec6ccb4425" (UID: "edd02d28-85fb-4cc3-b755-6fec6ccb4425"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 16:37:27.419133 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:27.419044 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edd02d28-85fb-4cc3-b755-6fec6ccb4425-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "edd02d28-85fb-4cc3-b755-6fec6ccb4425" (UID: "edd02d28-85fb-4cc3-b755-6fec6ccb4425"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 16:37:27.419133 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:27.419080 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edd02d28-85fb-4cc3-b755-6fec6ccb4425-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "edd02d28-85fb-4cc3-b755-6fec6ccb4425" (UID: "edd02d28-85fb-4cc3-b755-6fec6ccb4425"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 16:37:27.425398 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:27.425374 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edd02d28-85fb-4cc3-b755-6fec6ccb4425-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "edd02d28-85fb-4cc3-b755-6fec6ccb4425" (UID: "edd02d28-85fb-4cc3-b755-6fec6ccb4425"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 16:37:27.517121 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:27.517087 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c4zpj\" (UniqueName: \"kubernetes.io/projected/edd02d28-85fb-4cc3-b755-6fec6ccb4425-kube-api-access-c4zpj\") on node \"ip-10-0-140-245.ec2.internal\" DevicePath \"\"" Jul 28 16:37:27.517121 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:27.517113 2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/edd02d28-85fb-4cc3-b755-6fec6ccb4425-installation-pull-secrets\") on node \"ip-10-0-140-245.ec2.internal\" DevicePath \"\"" Jul 28 16:37:27.517121 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:27.517123 2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/edd02d28-85fb-4cc3-b755-6fec6ccb4425-registry-certificates\") on node \"ip-10-0-140-245.ec2.internal\" DevicePath \"\"" Jul 28 16:37:27.517121 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:27.517132 2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/edd02d28-85fb-4cc3-b755-6fec6ccb4425-ca-trust-extracted\") on node \"ip-10-0-140-245.ec2.internal\" DevicePath \"\"" Jul 28 16:37:27.517371 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:27.517142 2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/edd02d28-85fb-4cc3-b755-6fec6ccb4425-bound-sa-token\") on node \"ip-10-0-140-245.ec2.internal\" DevicePath \"\"" Jul 28 16:37:27.517371 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:27.517151 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/edd02d28-85fb-4cc3-b755-6fec6ccb4425-trusted-ca\") on node \"ip-10-0-140-245.ec2.internal\" DevicePath \"\"" Jul 28 16:37:27.517371 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:27.517160 2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/edd02d28-85fb-4cc3-b755-6fec6ccb4425-image-registry-private-configuration\") on node \"ip-10-0-140-245.ec2.internal\" DevicePath \"\"" Jul 28 16:37:27.517371 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:27.517170 2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/edd02d28-85fb-4cc3-b755-6fec6ccb4425-registry-tls\") on node \"ip-10-0-140-245.ec2.internal\" DevicePath \"\"" Jul 28 16:37:28.145805 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:28.145768 2563 generic.go:356] "Generic (PLEG): container finished" podID="edd02d28-85fb-4cc3-b755-6fec6ccb4425" containerID="99fa9baf041a2c253e72273469798174935442ac84e4092654fca6ef061f45f2" exitCode=0 Jul 28 16:37:28.146206 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:28.145826 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cb7b7498f-8m5rd" Jul 28 16:37:28.146206 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:28.145852 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7cb7b7498f-8m5rd" event={"ID":"edd02d28-85fb-4cc3-b755-6fec6ccb4425","Type":"ContainerDied","Data":"99fa9baf041a2c253e72273469798174935442ac84e4092654fca6ef061f45f2"} Jul 28 16:37:28.146206 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:28.145934 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7cb7b7498f-8m5rd" event={"ID":"edd02d28-85fb-4cc3-b755-6fec6ccb4425","Type":"ContainerDied","Data":"1efcc5462d671e5e2a1edabe7efcae424b4469b68377f658cb98d5c2bd6a7612"} Jul 28 16:37:28.146206 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:28.145972 2563 scope.go:117] "RemoveContainer" containerID="99fa9baf041a2c253e72273469798174935442ac84e4092654fca6ef061f45f2" Jul 28 16:37:28.162850 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:28.162825 2563 scope.go:117] "RemoveContainer" containerID="99fa9baf041a2c253e72273469798174935442ac84e4092654fca6ef061f45f2" Jul 28 16:37:28.163242 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:37:28.163198 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99fa9baf041a2c253e72273469798174935442ac84e4092654fca6ef061f45f2\": container with ID starting with 99fa9baf041a2c253e72273469798174935442ac84e4092654fca6ef061f45f2 not found: ID does not exist" containerID="99fa9baf041a2c253e72273469798174935442ac84e4092654fca6ef061f45f2" Jul 28 16:37:28.163456 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:28.163409 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99fa9baf041a2c253e72273469798174935442ac84e4092654fca6ef061f45f2"} err="failed to get container status \"99fa9baf041a2c253e72273469798174935442ac84e4092654fca6ef061f45f2\": rpc error: code = NotFound desc = could not find container \"99fa9baf041a2c253e72273469798174935442ac84e4092654fca6ef061f45f2\": container with ID starting with 99fa9baf041a2c253e72273469798174935442ac84e4092654fca6ef061f45f2 not found: ID does not exist" Jul 28 16:37:28.164653 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:28.164633 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7cb7b7498f-8m5rd"] Jul 28 16:37:28.167233 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:28.167200 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7cb7b7498f-8m5rd"] Jul 28 16:37:29.537466 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:29.537429 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:29.597492 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:29.597454 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:29.728253 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:29.728211 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="edd02d28-85fb-4cc3-b755-6fec6ccb4425" path="/var/lib/kubelet/pods/edd02d28-85fb-4cc3-b755-6fec6ccb4425/volumes" Jul 28 16:37:31.067279 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:31.067220 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:31.170776 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:31.170733 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:33.211056 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:33.211020 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:33.274009 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:33.273935 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:34.574523 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:34.574491 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-75d68f65c7-4fhnc"] Jul 28 16:37:34.574928 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:34.574731 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edd02d28-85fb-4cc3-b755-6fec6ccb4425" containerName="registry" Jul 28 16:37:34.574928 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:34.574741 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="edd02d28-85fb-4cc3-b755-6fec6ccb4425" containerName="registry" Jul 28 16:37:34.574928 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:34.574781 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="edd02d28-85fb-4cc3-b755-6fec6ccb4425" containerName="registry" Jul 28 16:37:34.860088 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:34.860006 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75d68f65c7-4fhnc"] Jul 28 16:37:34.860231 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:34.860109 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75d68f65c7-4fhnc" Jul 28 16:37:34.863548 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:34.863526 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 28 16:37:34.863703 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:34.863639 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 28 16:37:34.863703 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:34.863584 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 28 16:37:34.863824 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:34.863553 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 28 16:37:34.864069 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:34.864042 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f4598442-742f-46e7-b4f8-9e8f967c3890-console-config\") pod \"console-75d68f65c7-4fhnc\" (UID: \"f4598442-742f-46e7-b4f8-9e8f967c3890\") " pod="openshift-console/console-75d68f65c7-4fhnc" Jul 28 16:37:34.864156 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:34.864112 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f4598442-742f-46e7-b4f8-9e8f967c3890-console-oauth-config\") pod \"console-75d68f65c7-4fhnc\" (UID: \"f4598442-742f-46e7-b4f8-9e8f967c3890\") " pod="openshift-console/console-75d68f65c7-4fhnc" Jul 28 16:37:34.864198 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:34.864158 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f4598442-742f-46e7-b4f8-9e8f967c3890-service-ca\") pod \"console-75d68f65c7-4fhnc\" (UID: \"f4598442-742f-46e7-b4f8-9e8f967c3890\") " pod="openshift-console/console-75d68f65c7-4fhnc" Jul 28 16:37:34.864198 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:34.864182 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84clm\" (UniqueName: \"kubernetes.io/projected/f4598442-742f-46e7-b4f8-9e8f967c3890-kube-api-access-84clm\") pod \"console-75d68f65c7-4fhnc\" (UID: \"f4598442-742f-46e7-b4f8-9e8f967c3890\") " pod="openshift-console/console-75d68f65c7-4fhnc" Jul 28 16:37:34.864260 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:34.864243 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f4598442-742f-46e7-b4f8-9e8f967c3890-oauth-serving-cert\") pod \"console-75d68f65c7-4fhnc\" (UID: \"f4598442-742f-46e7-b4f8-9e8f967c3890\") " pod="openshift-console/console-75d68f65c7-4fhnc" Jul 28 16:37:34.864293 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:34.864265 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4598442-742f-46e7-b4f8-9e8f967c3890-trusted-ca-bundle\") pod \"console-75d68f65c7-4fhnc\" (UID: \"f4598442-742f-46e7-b4f8-9e8f967c3890\") " pod="openshift-console/console-75d68f65c7-4fhnc" Jul 28 16:37:34.864325 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:34.864290 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f4598442-742f-46e7-b4f8-9e8f967c3890-console-serving-cert\") pod \"console-75d68f65c7-4fhnc\" (UID: \"f4598442-742f-46e7-b4f8-9e8f967c3890\") " pod="openshift-console/console-75d68f65c7-4fhnc" Jul 28 16:37:34.864923 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:34.864908 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 28 16:37:34.865298 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:34.865285 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 28 16:37:34.865343 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:34.865286 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 28 16:37:34.866212 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:34.866193 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-sll5t\"" Jul 28 16:37:34.869724 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:34.869707 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 28 16:37:34.965160 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:34.965131 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f4598442-742f-46e7-b4f8-9e8f967c3890-console-config\") pod \"console-75d68f65c7-4fhnc\" (UID: \"f4598442-742f-46e7-b4f8-9e8f967c3890\") " pod="openshift-console/console-75d68f65c7-4fhnc" Jul 28 16:37:34.965356 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:34.965174 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f4598442-742f-46e7-b4f8-9e8f967c3890-console-oauth-config\") pod \"console-75d68f65c7-4fhnc\" (UID: \"f4598442-742f-46e7-b4f8-9e8f967c3890\") " pod="openshift-console/console-75d68f65c7-4fhnc" Jul 28 16:37:34.965356 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:34.965196 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f4598442-742f-46e7-b4f8-9e8f967c3890-service-ca\") pod \"console-75d68f65c7-4fhnc\" (UID: \"f4598442-742f-46e7-b4f8-9e8f967c3890\") " pod="openshift-console/console-75d68f65c7-4fhnc" Jul 28 16:37:34.965356 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:34.965217 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84clm\" (UniqueName: \"kubernetes.io/projected/f4598442-742f-46e7-b4f8-9e8f967c3890-kube-api-access-84clm\") pod \"console-75d68f65c7-4fhnc\" (UID: \"f4598442-742f-46e7-b4f8-9e8f967c3890\") " pod="openshift-console/console-75d68f65c7-4fhnc" Jul 28 16:37:34.965356 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:34.965267 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f4598442-742f-46e7-b4f8-9e8f967c3890-oauth-serving-cert\") pod \"console-75d68f65c7-4fhnc\" (UID: \"f4598442-742f-46e7-b4f8-9e8f967c3890\") " pod="openshift-console/console-75d68f65c7-4fhnc" Jul 28 16:37:34.965356 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:34.965292 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4598442-742f-46e7-b4f8-9e8f967c3890-trusted-ca-bundle\") pod \"console-75d68f65c7-4fhnc\" (UID: \"f4598442-742f-46e7-b4f8-9e8f967c3890\") " pod="openshift-console/console-75d68f65c7-4fhnc" Jul 28 16:37:34.965631 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:34.965505 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f4598442-742f-46e7-b4f8-9e8f967c3890-console-serving-cert\") pod \"console-75d68f65c7-4fhnc\" (UID: \"f4598442-742f-46e7-b4f8-9e8f967c3890\") " pod="openshift-console/console-75d68f65c7-4fhnc" Jul 28 16:37:34.966097 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:34.966073 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f4598442-742f-46e7-b4f8-9e8f967c3890-oauth-serving-cert\") pod \"console-75d68f65c7-4fhnc\" (UID: \"f4598442-742f-46e7-b4f8-9e8f967c3890\") " pod="openshift-console/console-75d68f65c7-4fhnc" Jul 28 16:37:34.966208 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:34.966102 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f4598442-742f-46e7-b4f8-9e8f967c3890-console-config\") pod \"console-75d68f65c7-4fhnc\" (UID: \"f4598442-742f-46e7-b4f8-9e8f967c3890\") " pod="openshift-console/console-75d68f65c7-4fhnc" Jul 28 16:37:34.966208 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:34.966071 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f4598442-742f-46e7-b4f8-9e8f967c3890-service-ca\") pod \"console-75d68f65c7-4fhnc\" (UID: \"f4598442-742f-46e7-b4f8-9e8f967c3890\") " pod="openshift-console/console-75d68f65c7-4fhnc" Jul 28 16:37:34.966323 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:34.966294 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4598442-742f-46e7-b4f8-9e8f967c3890-trusted-ca-bundle\") pod \"console-75d68f65c7-4fhnc\" (UID: \"f4598442-742f-46e7-b4f8-9e8f967c3890\") " pod="openshift-console/console-75d68f65c7-4fhnc" Jul 28 16:37:34.967743 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:34.967717 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f4598442-742f-46e7-b4f8-9e8f967c3890-console-oauth-config\") pod \"console-75d68f65c7-4fhnc\" (UID: \"f4598442-742f-46e7-b4f8-9e8f967c3890\") " pod="openshift-console/console-75d68f65c7-4fhnc" Jul 28 16:37:34.967916 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:34.967899 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f4598442-742f-46e7-b4f8-9e8f967c3890-console-serving-cert\") pod \"console-75d68f65c7-4fhnc\" (UID: \"f4598442-742f-46e7-b4f8-9e8f967c3890\") " pod="openshift-console/console-75d68f65c7-4fhnc" Jul 28 16:37:34.973453 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:34.973427 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84clm\" (UniqueName: \"kubernetes.io/projected/f4598442-742f-46e7-b4f8-9e8f967c3890-kube-api-access-84clm\") pod \"console-75d68f65c7-4fhnc\" (UID: \"f4598442-742f-46e7-b4f8-9e8f967c3890\") " pod="openshift-console/console-75d68f65c7-4fhnc" Jul 28 16:37:35.169242 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:35.169160 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75d68f65c7-4fhnc" Jul 28 16:37:35.321310 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:35.321283 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75d68f65c7-4fhnc"] Jul 28 16:37:35.323685 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:37:35.323653 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4598442_742f_46e7_b4f8_9e8f967c3890.slice/crio-3feadb80e11d5813aeb2047e674b4ec299f98ecb52a6063b32cf7706d9e85d41 WatchSource:0}: Error finding container 3feadb80e11d5813aeb2047e674b4ec299f98ecb52a6063b32cf7706d9e85d41: Status 404 returned error can't find the container with id 3feadb80e11d5813aeb2047e674b4ec299f98ecb52a6063b32cf7706d9e85d41 Jul 28 16:37:36.175815 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:36.175770 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75d68f65c7-4fhnc" event={"ID":"f4598442-742f-46e7-b4f8-9e8f967c3890","Type":"ContainerStarted","Data":"3feadb80e11d5813aeb2047e674b4ec299f98ecb52a6063b32cf7706d9e85d41"} Jul 28 16:37:36.943903 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:36.943867 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:36.998661 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:36.998601 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:38.238924 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:38.238891 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:38.340352 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:38.340317 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:39.189058 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:39.189020 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75d68f65c7-4fhnc" event={"ID":"f4598442-742f-46e7-b4f8-9e8f967c3890","Type":"ContainerStarted","Data":"9bbed6092e754dde5b8a05c9f8969026b256460a4e05673066e5d84980d79960"} Jul 28 16:37:39.208931 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:39.208885 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-75d68f65c7-4fhnc" podStartSLOduration=1.851087251 podStartE2EDuration="5.208867587s" totalImagesPullingTime="3.357780336s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:37:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:37:39.207986019 +0000 UTC m=+108.001782333" watchObservedRunningTime="2026-07-28 16:37:39.208867587 +0000 UTC m=+108.002663869" Jul 28 16:37:42.089238 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:42.089208 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wq5zz" Jul 28 16:37:42.253391 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:42.253357 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:42.306513 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:42.306482 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:44.528443 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:44.528409 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:44.593130 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:44.593097 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:45.169650 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:45.169621 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75d68f65c7-4fhnc" Jul 28 16:37:45.169810 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:45.169674 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-75d68f65c7-4fhnc" Jul 28 16:37:45.174222 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:45.174201 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-75d68f65c7-4fhnc" Jul 28 16:37:45.212356 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:45.212332 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-75d68f65c7-4fhnc" Jul 28 16:37:45.359126 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:45.359095 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:45.418596 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:45.418564 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:45.491747 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:45.491662 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:59.540468 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:59.540427 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:37:59.597479 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:37:59.597426 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:38:30.609903 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:38:30.609868 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:38:30.711817 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:38:30.711773 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:38:42.466767 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:38:42.466736 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:38:42.531055 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:38:42.531025 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:38:43.611985 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:38:43.611905 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:38:43.757582 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:38:43.757546 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:38:44.356501 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:38:44.356469 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:38:54.499820 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:38:54.499789 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75d68f65c7-4fhnc"] Jul 28 16:38:54.688873 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:38:54.688838 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:38:54.788257 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:38:54.788230 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:38:59.536280 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:38:59.536240 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:38:59.637764 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:38:59.637736 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:39:18.586997 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:39:18.586960 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:39:19.518235 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:39:19.518178 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-75d68f65c7-4fhnc" podUID="f4598442-742f-46e7-b4f8-9e8f967c3890" containerName="console" containerID="cri-o://9bbed6092e754dde5b8a05c9f8969026b256460a4e05673066e5d84980d79960" gracePeriod=15 Jul 28 16:39:19.757898 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:39:19.757873 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75d68f65c7-4fhnc" Jul 28 16:39:19.838710 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:39:19.838677 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84clm\" (UniqueName: \"kubernetes.io/projected/f4598442-742f-46e7-b4f8-9e8f967c3890-kube-api-access-84clm\") pod \"f4598442-742f-46e7-b4f8-9e8f967c3890\" (UID: \"f4598442-742f-46e7-b4f8-9e8f967c3890\") " Jul 28 16:39:19.838710 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:39:19.838714 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f4598442-742f-46e7-b4f8-9e8f967c3890-console-config\") pod \"f4598442-742f-46e7-b4f8-9e8f967c3890\" (UID: \"f4598442-742f-46e7-b4f8-9e8f967c3890\") " Jul 28 16:39:19.838948 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:39:19.838761 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4598442-742f-46e7-b4f8-9e8f967c3890-trusted-ca-bundle\") pod \"f4598442-742f-46e7-b4f8-9e8f967c3890\" (UID: \"f4598442-742f-46e7-b4f8-9e8f967c3890\") " Jul 28 16:39:19.838948 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:39:19.838789 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f4598442-742f-46e7-b4f8-9e8f967c3890-console-oauth-config\") pod \"f4598442-742f-46e7-b4f8-9e8f967c3890\" (UID: \"f4598442-742f-46e7-b4f8-9e8f967c3890\") " Jul 28 16:39:19.838948 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:39:19.838814 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f4598442-742f-46e7-b4f8-9e8f967c3890-service-ca\") pod \"f4598442-742f-46e7-b4f8-9e8f967c3890\" (UID: \"f4598442-742f-46e7-b4f8-9e8f967c3890\") " Jul 28 16:39:19.838948 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:39:19.838860 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f4598442-742f-46e7-b4f8-9e8f967c3890-oauth-serving-cert\") pod \"f4598442-742f-46e7-b4f8-9e8f967c3890\" (UID: \"f4598442-742f-46e7-b4f8-9e8f967c3890\") " Jul 28 16:39:19.838948 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:39:19.838921 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f4598442-742f-46e7-b4f8-9e8f967c3890-console-serving-cert\") pod \"f4598442-742f-46e7-b4f8-9e8f967c3890\" (UID: \"f4598442-742f-46e7-b4f8-9e8f967c3890\") " Jul 28 16:39:19.839249 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:39:19.839164 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4598442-742f-46e7-b4f8-9e8f967c3890-console-config" (OuterVolumeSpecName: "console-config") pod "f4598442-742f-46e7-b4f8-9e8f967c3890" (UID: "f4598442-742f-46e7-b4f8-9e8f967c3890"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 16:39:19.839379 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:39:19.839332 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4598442-742f-46e7-b4f8-9e8f967c3890-service-ca" (OuterVolumeSpecName: "service-ca") pod "f4598442-742f-46e7-b4f8-9e8f967c3890" (UID: "f4598442-742f-46e7-b4f8-9e8f967c3890"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 16:39:19.839379 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:39:19.839338 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4598442-742f-46e7-b4f8-9e8f967c3890-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f4598442-742f-46e7-b4f8-9e8f967c3890" (UID: "f4598442-742f-46e7-b4f8-9e8f967c3890"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 16:39:19.839501 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:39:19.839448 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4598442-742f-46e7-b4f8-9e8f967c3890-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f4598442-742f-46e7-b4f8-9e8f967c3890" (UID: "f4598442-742f-46e7-b4f8-9e8f967c3890"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 16:39:19.841021 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:39:19.840999 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4598442-742f-46e7-b4f8-9e8f967c3890-kube-api-access-84clm" (OuterVolumeSpecName: "kube-api-access-84clm") pod "f4598442-742f-46e7-b4f8-9e8f967c3890" (UID: "f4598442-742f-46e7-b4f8-9e8f967c3890"). InnerVolumeSpecName "kube-api-access-84clm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 16:39:19.841103 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:39:19.841081 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4598442-742f-46e7-b4f8-9e8f967c3890-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f4598442-742f-46e7-b4f8-9e8f967c3890" (UID: "f4598442-742f-46e7-b4f8-9e8f967c3890"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 16:39:19.841103 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:39:19.841093 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4598442-742f-46e7-b4f8-9e8f967c3890-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f4598442-742f-46e7-b4f8-9e8f967c3890" (UID: "f4598442-742f-46e7-b4f8-9e8f967c3890"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 16:39:19.939801 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:39:19.939765 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4598442-742f-46e7-b4f8-9e8f967c3890-trusted-ca-bundle\") on node \"ip-10-0-140-245.ec2.internal\" DevicePath \"\"" Jul 28 16:39:19.939801 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:39:19.939795 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f4598442-742f-46e7-b4f8-9e8f967c3890-console-oauth-config\") on node \"ip-10-0-140-245.ec2.internal\" DevicePath \"\"" Jul 28 16:39:19.939801 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:39:19.939804 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f4598442-742f-46e7-b4f8-9e8f967c3890-service-ca\") on node \"ip-10-0-140-245.ec2.internal\" DevicePath \"\"" Jul 28 16:39:19.940026 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:39:19.939814 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f4598442-742f-46e7-b4f8-9e8f967c3890-oauth-serving-cert\") on node \"ip-10-0-140-245.ec2.internal\" DevicePath \"\"" Jul 28 16:39:19.940026 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:39:19.939822 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f4598442-742f-46e7-b4f8-9e8f967c3890-console-serving-cert\") on node \"ip-10-0-140-245.ec2.internal\" DevicePath \"\"" Jul 28 16:39:19.940026 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:39:19.939831 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84clm\" (UniqueName: \"kubernetes.io/projected/f4598442-742f-46e7-b4f8-9e8f967c3890-kube-api-access-84clm\") on node \"ip-10-0-140-245.ec2.internal\" DevicePath \"\"" Jul 28 16:39:19.940026 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:39:19.939839 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f4598442-742f-46e7-b4f8-9e8f967c3890-console-config\") on node \"ip-10-0-140-245.ec2.internal\" DevicePath \"\"" Jul 28 16:39:20.521009 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:39:20.520974 2563 generic.go:356] "Generic (PLEG): container finished" podID="f4598442-742f-46e7-b4f8-9e8f967c3890" containerID="9bbed6092e754dde5b8a05c9f8969026b256460a4e05673066e5d84980d79960" exitCode=0 Jul 28 16:39:20.521180 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:39:20.521026 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75d68f65c7-4fhnc" Jul 28 16:39:20.521180 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:39:20.521052 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75d68f65c7-4fhnc" event={"ID":"f4598442-742f-46e7-b4f8-9e8f967c3890","Type":"ContainerDied","Data":"9bbed6092e754dde5b8a05c9f8969026b256460a4e05673066e5d84980d79960"} Jul 28 16:39:20.521180 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:39:20.521101 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75d68f65c7-4fhnc" event={"ID":"f4598442-742f-46e7-b4f8-9e8f967c3890","Type":"ContainerDied","Data":"3feadb80e11d5813aeb2047e674b4ec299f98ecb52a6063b32cf7706d9e85d41"} Jul 28 16:39:20.521180 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:39:20.521127 2563 scope.go:117] "RemoveContainer" containerID="9bbed6092e754dde5b8a05c9f8969026b256460a4e05673066e5d84980d79960" Jul 28 16:39:20.529167 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:39:20.529147 2563 scope.go:117] "RemoveContainer" containerID="9bbed6092e754dde5b8a05c9f8969026b256460a4e05673066e5d84980d79960" Jul 28 16:39:20.529403 ip-10-0-140-245 kubenswrapper[2563]: E0728 16:39:20.529384 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bbed6092e754dde5b8a05c9f8969026b256460a4e05673066e5d84980d79960\": container with ID starting with 9bbed6092e754dde5b8a05c9f8969026b256460a4e05673066e5d84980d79960 not found: ID does not exist" containerID="9bbed6092e754dde5b8a05c9f8969026b256460a4e05673066e5d84980d79960" Jul 28 16:39:20.529449 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:39:20.529410 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bbed6092e754dde5b8a05c9f8969026b256460a4e05673066e5d84980d79960"} err="failed to get container status \"9bbed6092e754dde5b8a05c9f8969026b256460a4e05673066e5d84980d79960\": rpc error: code = NotFound desc = could not find container \"9bbed6092e754dde5b8a05c9f8969026b256460a4e05673066e5d84980d79960\": container with ID starting with 9bbed6092e754dde5b8a05c9f8969026b256460a4e05673066e5d84980d79960 not found: ID does not exist" Jul 28 16:39:20.541528 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:39:20.541502 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75d68f65c7-4fhnc"] Jul 28 16:39:20.544111 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:39:20.544088 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-75d68f65c7-4fhnc"] Jul 28 16:39:21.728563 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:39:21.728527 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4598442-742f-46e7-b4f8-9e8f967c3890" path="/var/lib/kubelet/pods/f4598442-742f-46e7-b4f8-9e8f967c3890/volumes" Jul 28 16:39:24.735908 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:39:24.735870 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:39:24.791572 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:39:24.791542 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:39:26.267727 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:39:26.267698 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:39:34.864492 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:39:34.864455 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:39:45.185588 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:39:45.185551 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:39:45.286540 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:39:45.286503 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:40:12.221942 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:12.221906 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:40:13.576039 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:13.575963 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:40:15.841089 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:15.841058 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:40:15.899380 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:15.899348 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:40:17.277367 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:17.277335 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:40:17.377655 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:17.377600 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:40:19.649150 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:19.649096 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:40:19.864697 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:19.864663 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:40:20.836685 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:20.836652 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:40:20.937507 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:20.937445 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:40:26.448919 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:26.448882 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:40:26.536488 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:26.536461 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:40:27.035304 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:27.035263 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:40:27.727553 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:27.727524 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-rsnx4"] Jul 28 16:40:27.727934 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:27.727744 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4598442-742f-46e7-b4f8-9e8f967c3890" containerName="console" Jul 28 16:40:27.727934 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:27.727754 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4598442-742f-46e7-b4f8-9e8f967c3890" containerName="console" Jul 28 16:40:27.727934 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:27.727794 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4598442-742f-46e7-b4f8-9e8f967c3890" containerName="console" Jul 28 16:40:27.730391 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:27.730373 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-rsnx4" Jul 28 16:40:27.733109 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:27.733087 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-5wpx6\"" Jul 28 16:40:27.733211 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:27.733169 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 28 16:40:27.734325 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:27.734309 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 28 16:40:27.738749 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:27.738731 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-rsnx4"] Jul 28 16:40:27.809094 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:27.809058 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d624d41a-bb00-4ae2-b32d-5fabc25f4ded-bound-sa-token\") pod \"cert-manager-55b4d954d5-rsnx4\" (UID: \"d624d41a-bb00-4ae2-b32d-5fabc25f4ded\") " pod="cert-manager/cert-manager-55b4d954d5-rsnx4" Jul 28 16:40:27.809258 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:27.809108 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvd7z\" (UniqueName: \"kubernetes.io/projected/d624d41a-bb00-4ae2-b32d-5fabc25f4ded-kube-api-access-rvd7z\") pod \"cert-manager-55b4d954d5-rsnx4\" (UID: \"d624d41a-bb00-4ae2-b32d-5fabc25f4ded\") " pod="cert-manager/cert-manager-55b4d954d5-rsnx4" Jul 28 16:40:27.909564 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:27.909529 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d624d41a-bb00-4ae2-b32d-5fabc25f4ded-bound-sa-token\") pod \"cert-manager-55b4d954d5-rsnx4\" (UID: \"d624d41a-bb00-4ae2-b32d-5fabc25f4ded\") " pod="cert-manager/cert-manager-55b4d954d5-rsnx4" Jul 28 16:40:27.909740 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:27.909578 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvd7z\" (UniqueName: \"kubernetes.io/projected/d624d41a-bb00-4ae2-b32d-5fabc25f4ded-kube-api-access-rvd7z\") pod \"cert-manager-55b4d954d5-rsnx4\" (UID: \"d624d41a-bb00-4ae2-b32d-5fabc25f4ded\") " pod="cert-manager/cert-manager-55b4d954d5-rsnx4" Jul 28 16:40:27.918866 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:27.918836 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d624d41a-bb00-4ae2-b32d-5fabc25f4ded-bound-sa-token\") pod \"cert-manager-55b4d954d5-rsnx4\" (UID: \"d624d41a-bb00-4ae2-b32d-5fabc25f4ded\") " pod="cert-manager/cert-manager-55b4d954d5-rsnx4" Jul 28 16:40:27.918980 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:27.918940 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvd7z\" (UniqueName: \"kubernetes.io/projected/d624d41a-bb00-4ae2-b32d-5fabc25f4ded-kube-api-access-rvd7z\") pod \"cert-manager-55b4d954d5-rsnx4\" (UID: \"d624d41a-bb00-4ae2-b32d-5fabc25f4ded\") " pod="cert-manager/cert-manager-55b4d954d5-rsnx4" Jul 28 16:40:28.038830 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:28.038798 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-rsnx4" Jul 28 16:40:28.167548 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:28.167522 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-rsnx4"] Jul 28 16:40:28.170232 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:40:28.170207 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd624d41a_bb00_4ae2_b32d_5fabc25f4ded.slice/crio-d7143d12c474f2c5164ce651e56483ca5eac069b9cb063d29852c1784d5d8cd1 WatchSource:0}: Error finding container d7143d12c474f2c5164ce651e56483ca5eac069b9cb063d29852c1784d5d8cd1: Status 404 returned error can't find the container with id d7143d12c474f2c5164ce651e56483ca5eac069b9cb063d29852c1784d5d8cd1 Jul 28 16:40:28.736292 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:28.736260 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-rsnx4" event={"ID":"d624d41a-bb00-4ae2-b32d-5fabc25f4ded","Type":"ContainerStarted","Data":"d7143d12c474f2c5164ce651e56483ca5eac069b9cb063d29852c1784d5d8cd1"} Jul 28 16:40:31.748673 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:31.748572 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-rsnx4" event={"ID":"d624d41a-bb00-4ae2-b32d-5fabc25f4ded","Type":"ContainerStarted","Data":"bf9bf3e9db7b5fb8bf8791ca0d419d2209540dcff2adcc145d105f4422bd8b1e"} Jul 28 16:40:31.767963 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:31.767914 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-rsnx4" podStartSLOduration=1.6163992120000001 podStartE2EDuration="4.767899532s" totalImagesPullingTime="3.15150032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:40:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:40:31.766970742 +0000 UTC m=+280.560767131" watchObservedRunningTime="2026-07-28 16:40:31.767899532 +0000 UTC m=+280.561695808" Jul 28 16:40:31.945355 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:31.945323 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:40:32.045552 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:32.045521 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:40:43.040407 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:43.040371 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:40:43.140304 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:43.140271 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:40:51.547393 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:51.547363 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vjvs7_021148b1-76cd-486f-a99d-e45527a9323e/ovn-acl-logging/0.log" Jul 28 16:40:51.551940 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:51.551915 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vjvs7_021148b1-76cd-486f-a99d-e45527a9323e/ovn-acl-logging/0.log" Jul 28 16:40:51.552799 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:51.552777 2563 kubelet.go:1648] "Image garbage collection succeeded" Jul 28 16:40:52.663720 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:52.663689 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:40:54.695155 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:54.695126 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-579497545c-q2stn"] Jul 28 16:40:54.696975 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:54.696960 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-579497545c-q2stn" Jul 28 16:40:54.699698 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:54.699674 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Jul 28 16:40:54.700962 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:54.700943 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-controller-manager-dockercfg-j8prr\"" Jul 28 16:40:54.701105 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:54.701085 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"webhook-server-cert\"" Jul 28 16:40:54.701192 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:54.701147 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Jul 28 16:40:54.701266 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:54.701254 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"jobset-manager-config\"" Jul 28 16:40:54.701327 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:54.701313 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"metrics-server-cert\"" Jul 28 16:40:54.706630 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:54.706595 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-579497545c-q2stn"] Jul 28 16:40:54.800084 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:54.800046 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1057acb3-819f-4dbc-b7e3-785c5528e735-cert\") pod \"jobset-controller-manager-579497545c-q2stn\" (UID: \"1057acb3-819f-4dbc-b7e3-785c5528e735\") " pod="openshift-jobset-operator/jobset-controller-manager-579497545c-q2stn" Jul 28 16:40:54.800084 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:54.800085 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1057acb3-819f-4dbc-b7e3-785c5528e735-manager-config\") pod \"jobset-controller-manager-579497545c-q2stn\" (UID: \"1057acb3-819f-4dbc-b7e3-785c5528e735\") " pod="openshift-jobset-operator/jobset-controller-manager-579497545c-q2stn" Jul 28 16:40:54.800299 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:54.800111 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1057acb3-819f-4dbc-b7e3-785c5528e735-metrics-certs\") pod \"jobset-controller-manager-579497545c-q2stn\" (UID: \"1057acb3-819f-4dbc-b7e3-785c5528e735\") " pod="openshift-jobset-operator/jobset-controller-manager-579497545c-q2stn" Jul 28 16:40:54.800299 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:54.800148 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfr6n\" (UniqueName: \"kubernetes.io/projected/1057acb3-819f-4dbc-b7e3-785c5528e735-kube-api-access-dfr6n\") pod \"jobset-controller-manager-579497545c-q2stn\" (UID: \"1057acb3-819f-4dbc-b7e3-785c5528e735\") " pod="openshift-jobset-operator/jobset-controller-manager-579497545c-q2stn" Jul 28 16:40:54.900967 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:54.900919 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1057acb3-819f-4dbc-b7e3-785c5528e735-metrics-certs\") pod \"jobset-controller-manager-579497545c-q2stn\" (UID: \"1057acb3-819f-4dbc-b7e3-785c5528e735\") " pod="openshift-jobset-operator/jobset-controller-manager-579497545c-q2stn" Jul 28 16:40:54.900967 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:54.900966 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfr6n\" (UniqueName: \"kubernetes.io/projected/1057acb3-819f-4dbc-b7e3-785c5528e735-kube-api-access-dfr6n\") pod \"jobset-controller-manager-579497545c-q2stn\" (UID: \"1057acb3-819f-4dbc-b7e3-785c5528e735\") " pod="openshift-jobset-operator/jobset-controller-manager-579497545c-q2stn" Jul 28 16:40:54.901243 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:54.901044 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1057acb3-819f-4dbc-b7e3-785c5528e735-cert\") pod \"jobset-controller-manager-579497545c-q2stn\" (UID: \"1057acb3-819f-4dbc-b7e3-785c5528e735\") " pod="openshift-jobset-operator/jobset-controller-manager-579497545c-q2stn" Jul 28 16:40:54.901243 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:54.901066 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1057acb3-819f-4dbc-b7e3-785c5528e735-manager-config\") pod \"jobset-controller-manager-579497545c-q2stn\" (UID: \"1057acb3-819f-4dbc-b7e3-785c5528e735\") " pod="openshift-jobset-operator/jobset-controller-manager-579497545c-q2stn" Jul 28 16:40:54.901739 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:54.901719 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1057acb3-819f-4dbc-b7e3-785c5528e735-manager-config\") pod \"jobset-controller-manager-579497545c-q2stn\" (UID: \"1057acb3-819f-4dbc-b7e3-785c5528e735\") " pod="openshift-jobset-operator/jobset-controller-manager-579497545c-q2stn" Jul 28 16:40:54.903457 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:54.903435 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1057acb3-819f-4dbc-b7e3-785c5528e735-cert\") pod \"jobset-controller-manager-579497545c-q2stn\" (UID: \"1057acb3-819f-4dbc-b7e3-785c5528e735\") " pod="openshift-jobset-operator/jobset-controller-manager-579497545c-q2stn" Jul 28 16:40:54.903680 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:54.903659 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1057acb3-819f-4dbc-b7e3-785c5528e735-metrics-certs\") pod \"jobset-controller-manager-579497545c-q2stn\" (UID: \"1057acb3-819f-4dbc-b7e3-785c5528e735\") " pod="openshift-jobset-operator/jobset-controller-manager-579497545c-q2stn" Jul 28 16:40:54.909884 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:54.909853 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfr6n\" (UniqueName: \"kubernetes.io/projected/1057acb3-819f-4dbc-b7e3-785c5528e735-kube-api-access-dfr6n\") pod \"jobset-controller-manager-579497545c-q2stn\" (UID: \"1057acb3-819f-4dbc-b7e3-785c5528e735\") " pod="openshift-jobset-operator/jobset-controller-manager-579497545c-q2stn" Jul 28 16:40:55.006035 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:55.005943 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-579497545c-q2stn" Jul 28 16:40:55.047313 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:55.047276 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:40:55.134737 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:55.133569 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-579497545c-q2stn"] Jul 28 16:40:55.138494 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:55.138478 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 16:40:55.825031 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:55.824994 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-579497545c-q2stn" event={"ID":"1057acb3-819f-4dbc-b7e3-785c5528e735","Type":"ContainerStarted","Data":"5c2f5a50a14d3030bdccd97055361ee82baec84f600492a62f751832db4e408f"} Jul 28 16:40:55.876944 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:40:55.876896 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:41:01.847339 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:41:01.847300 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-579497545c-q2stn" event={"ID":"1057acb3-819f-4dbc-b7e3-785c5528e735","Type":"ContainerStarted","Data":"4c4f36ff675aa2862008b71b20339d975c45bed406a1d6ddff162804ff02f20c"} Jul 28 16:41:01.847735 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:41:01.847386 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-jobset-operator/jobset-controller-manager-579497545c-q2stn" Jul 28 16:41:01.865139 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:41:01.865091 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-controller-manager-579497545c-q2stn" podStartSLOduration=1.660710305 podStartE2EDuration="7.865074908s" totalImagesPullingTime="6.204364603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:40:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:41:01.864350134 +0000 UTC m=+310.658146411" watchObservedRunningTime="2026-07-28 16:41:01.865074908 +0000 UTC m=+310.658871184" Jul 28 16:41:12.856507 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:41:12.856477 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-jobset-operator/jobset-controller-manager-579497545c-q2stn" Jul 28 16:41:13.117720 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:41:13.117604 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:41:13.218753 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:41:13.218719 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:41:16.070732 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:41:16.070698 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:41:16.305093 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:41:16.305061 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:41:19.425917 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:41:19.425869 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:41:22.726780 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:41:22.726746 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:41:41.289159 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:41:41.289130 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:41:41.346126 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:41:41.346089 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:41:43.226264 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:41:43.226183 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:41:43.286173 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:41:43.286137 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:42:38.591760 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:42:38.591725 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:42:38.692222 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:42:38.692191 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:42:38.755921 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:42:38.755891 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:42:41.026728 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:42:41.026695 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-86dfb8f774-885mg"] Jul 28 16:42:41.029624 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:42:41.029594 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86dfb8f774-885mg" Jul 28 16:42:41.032505 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:42:41.032483 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 28 16:42:41.033484 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:42:41.033463 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 28 16:42:41.033588 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:42:41.033507 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 28 16:42:41.033588 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:42:41.033469 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 28 16:42:41.033823 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:42:41.033806 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 28 16:42:41.033894 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:42:41.033879 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 28 16:42:41.033957 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:42:41.033939 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 28 16:42:41.034011 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:42:41.033987 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-sll5t\"" Jul 28 16:42:41.038511 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:42:41.038491 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 28 16:42:41.042704 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:42:41.042678 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86dfb8f774-885mg"] Jul 28 16:42:41.080215 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:42:41.080185 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:42:41.142759 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:42:41.142729 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:42:41.172335 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:42:41.172311 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a88197ff-18e4-4111-a646-24907673c012-service-ca\") pod \"console-86dfb8f774-885mg\" (UID: \"a88197ff-18e4-4111-a646-24907673c012\") " pod="openshift-console/console-86dfb8f774-885mg" Jul 28 16:42:41.172444 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:42:41.172340 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a88197ff-18e4-4111-a646-24907673c012-console-config\") pod \"console-86dfb8f774-885mg\" (UID: \"a88197ff-18e4-4111-a646-24907673c012\") " pod="openshift-console/console-86dfb8f774-885mg" Jul 28 16:42:41.172444 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:42:41.172359 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a88197ff-18e4-4111-a646-24907673c012-oauth-serving-cert\") pod \"console-86dfb8f774-885mg\" (UID: \"a88197ff-18e4-4111-a646-24907673c012\") " pod="openshift-console/console-86dfb8f774-885mg" Jul 28 16:42:41.172444 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:42:41.172404 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a88197ff-18e4-4111-a646-24907673c012-console-oauth-config\") pod \"console-86dfb8f774-885mg\" (UID: \"a88197ff-18e4-4111-a646-24907673c012\") " pod="openshift-console/console-86dfb8f774-885mg" Jul 28 16:42:41.172548 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:42:41.172448 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbpqj\" (UniqueName: \"kubernetes.io/projected/a88197ff-18e4-4111-a646-24907673c012-kube-api-access-xbpqj\") pod \"console-86dfb8f774-885mg\" (UID: \"a88197ff-18e4-4111-a646-24907673c012\") " pod="openshift-console/console-86dfb8f774-885mg" Jul 28 16:42:41.172548 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:42:41.172494 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a88197ff-18e4-4111-a646-24907673c012-trusted-ca-bundle\") pod \"console-86dfb8f774-885mg\" (UID: \"a88197ff-18e4-4111-a646-24907673c012\") " pod="openshift-console/console-86dfb8f774-885mg" Jul 28 16:42:41.172548 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:42:41.172523 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a88197ff-18e4-4111-a646-24907673c012-console-serving-cert\") pod \"console-86dfb8f774-885mg\" (UID: \"a88197ff-18e4-4111-a646-24907673c012\") " pod="openshift-console/console-86dfb8f774-885mg" Jul 28 16:42:41.273296 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:42:41.273263 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a88197ff-18e4-4111-a646-24907673c012-console-oauth-config\") pod \"console-86dfb8f774-885mg\" (UID: \"a88197ff-18e4-4111-a646-24907673c012\") " pod="openshift-console/console-86dfb8f774-885mg" Jul 28 16:42:41.273456 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:42:41.273310 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbpqj\" (UniqueName: \"kubernetes.io/projected/a88197ff-18e4-4111-a646-24907673c012-kube-api-access-xbpqj\") pod \"console-86dfb8f774-885mg\" (UID: \"a88197ff-18e4-4111-a646-24907673c012\") " pod="openshift-console/console-86dfb8f774-885mg" Jul 28 16:42:41.273456 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:42:41.273331 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a88197ff-18e4-4111-a646-24907673c012-trusted-ca-bundle\") pod \"console-86dfb8f774-885mg\" (UID: \"a88197ff-18e4-4111-a646-24907673c012\") " pod="openshift-console/console-86dfb8f774-885mg" Jul 28 16:42:41.273456 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:42:41.273357 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a88197ff-18e4-4111-a646-24907673c012-console-serving-cert\") pod \"console-86dfb8f774-885mg\" (UID: \"a88197ff-18e4-4111-a646-24907673c012\") " pod="openshift-console/console-86dfb8f774-885mg" Jul 28 16:42:41.273456 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:42:41.273387 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a88197ff-18e4-4111-a646-24907673c012-service-ca\") pod \"console-86dfb8f774-885mg\" (UID: \"a88197ff-18e4-4111-a646-24907673c012\") " pod="openshift-console/console-86dfb8f774-885mg" Jul 28 16:42:41.273456 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:42:41.273403 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a88197ff-18e4-4111-a646-24907673c012-console-config\") pod \"console-86dfb8f774-885mg\" (UID: \"a88197ff-18e4-4111-a646-24907673c012\") " pod="openshift-console/console-86dfb8f774-885mg" Jul 28 16:42:41.273456 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:42:41.273417 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a88197ff-18e4-4111-a646-24907673c012-oauth-serving-cert\") pod \"console-86dfb8f774-885mg\" (UID: \"a88197ff-18e4-4111-a646-24907673c012\") " pod="openshift-console/console-86dfb8f774-885mg" Jul 28 16:42:41.274326 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:42:41.274299 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a88197ff-18e4-4111-a646-24907673c012-service-ca\") pod \"console-86dfb8f774-885mg\" (UID: \"a88197ff-18e4-4111-a646-24907673c012\") " pod="openshift-console/console-86dfb8f774-885mg" Jul 28 16:42:41.274432 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:42:41.274308 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a88197ff-18e4-4111-a646-24907673c012-console-config\") pod \"console-86dfb8f774-885mg\" (UID: \"a88197ff-18e4-4111-a646-24907673c012\") " pod="openshift-console/console-86dfb8f774-885mg" Jul 28 16:42:41.274432 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:42:41.274336 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a88197ff-18e4-4111-a646-24907673c012-oauth-serving-cert\") pod \"console-86dfb8f774-885mg\" (UID: \"a88197ff-18e4-4111-a646-24907673c012\") " pod="openshift-console/console-86dfb8f774-885mg" Jul 28 16:42:41.274545 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:42:41.274500 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a88197ff-18e4-4111-a646-24907673c012-trusted-ca-bundle\") pod \"console-86dfb8f774-885mg\" (UID: \"a88197ff-18e4-4111-a646-24907673c012\") " pod="openshift-console/console-86dfb8f774-885mg" Jul 28 16:42:41.275885 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:42:41.275862 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a88197ff-18e4-4111-a646-24907673c012-console-serving-cert\") pod \"console-86dfb8f774-885mg\" (UID: \"a88197ff-18e4-4111-a646-24907673c012\") " pod="openshift-console/console-86dfb8f774-885mg" Jul 28 16:42:41.275962 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:42:41.275927 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a88197ff-18e4-4111-a646-24907673c012-console-oauth-config\") pod \"console-86dfb8f774-885mg\" (UID: \"a88197ff-18e4-4111-a646-24907673c012\") " pod="openshift-console/console-86dfb8f774-885mg" Jul 28 16:42:41.282338 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:42:41.282288 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbpqj\" (UniqueName: \"kubernetes.io/projected/a88197ff-18e4-4111-a646-24907673c012-kube-api-access-xbpqj\") pod \"console-86dfb8f774-885mg\" (UID: \"a88197ff-18e4-4111-a646-24907673c012\") " pod="openshift-console/console-86dfb8f774-885mg" Jul 28 16:42:41.338746 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:42:41.338712 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86dfb8f774-885mg" Jul 28 16:42:41.466066 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:42:41.466036 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86dfb8f774-885mg"] Jul 28 16:42:41.468493 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:42:41.468459 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda88197ff_18e4_4111_a646_24907673c012.slice/crio-c7c303d6b4d31eb6de743cee5199d0bfcf60c39620947a5c9d8a29517c9e5dff WatchSource:0}: Error finding container c7c303d6b4d31eb6de743cee5199d0bfcf60c39620947a5c9d8a29517c9e5dff: Status 404 returned error can't find the container with id c7c303d6b4d31eb6de743cee5199d0bfcf60c39620947a5c9d8a29517c9e5dff Jul 28 16:42:42.169773 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:42:42.169734 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86dfb8f774-885mg" event={"ID":"a88197ff-18e4-4111-a646-24907673c012","Type":"ContainerStarted","Data":"8120f1e7d8b9ec046f8907b18948591d3344f948649c66d143de4b9a72a95ae4"} Jul 28 16:42:42.170178 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:42:42.169786 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86dfb8f774-885mg" event={"ID":"a88197ff-18e4-4111-a646-24907673c012","Type":"ContainerStarted","Data":"c7c303d6b4d31eb6de743cee5199d0bfcf60c39620947a5c9d8a29517c9e5dff"} Jul 28 16:42:42.188074 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:42:42.188025 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-86dfb8f774-885mg" podStartSLOduration=1.188009412 podStartE2EDuration="1.188009412s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:42:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:42:42.186535352 +0000 UTC m=+410.980331641" watchObservedRunningTime="2026-07-28 16:42:42.188009412 +0000 UTC m=+410.981805688" Jul 28 16:42:51.339556 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:42:51.339523 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86dfb8f774-885mg" Jul 28 16:42:51.340006 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:42:51.339900 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-86dfb8f774-885mg" Jul 28 16:42:51.344766 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:42:51.344745 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-86dfb8f774-885mg" Jul 28 16:42:52.207208 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:42:52.207180 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-86dfb8f774-885mg" Jul 28 16:42:52.369266 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:42:52.369232 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:42:52.468671 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:42:52.468591 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:42:52.568550 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:42:52.568509 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:43:37.107858 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:43:37.107822 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:43:37.161505 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:43:37.161480 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:43:54.550123 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:43:54.550086 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:44:08.880054 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:44:08.880017 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:45:03.223239 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:45:03.223146 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:45:38.245859 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:45:38.245825 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:45:41.109502 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:45:41.109463 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:45:51.567730 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:45:51.567699 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vjvs7_021148b1-76cd-486f-a99d-e45527a9323e/ovn-acl-logging/0.log" Jul 28 16:45:51.575337 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:45:51.575312 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vjvs7_021148b1-76cd-486f-a99d-e45527a9323e/ovn-acl-logging/0.log" Jul 28 16:45:53.289332 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:45:53.289296 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:45:53.827760 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:45:53.827729 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-42db9/progression-job-failure-node-0-0-vlgdn"] Jul 28 16:45:53.830662 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:45:53.830641 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-42db9/progression-job-failure-node-0-0-vlgdn" Jul 28 16:45:53.833429 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:45:53.833396 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-42db9\"/\"openshift-service-ca.crt\"" Jul 28 16:45:53.833429 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:45:53.833397 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-42db9\"/\"default-dockercfg-dm2fx\"" Jul 28 16:45:53.833598 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:45:53.833433 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-42db9\"/\"kube-root-ca.crt\"" Jul 28 16:45:53.840049 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:45:53.840027 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-42db9/progression-job-failure-node-0-0-vlgdn"] Jul 28 16:45:53.843567 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:45:53.843544 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:45:53.935111 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:45:53.935080 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5d6v\" (UniqueName: \"kubernetes.io/projected/08f6a004-feb7-48a7-a076-31a435bfcd0a-kube-api-access-n5d6v\") pod \"progression-job-failure-node-0-0-vlgdn\" (UID: \"08f6a004-feb7-48a7-a076-31a435bfcd0a\") " pod="rhai-e2e-progression-42db9/progression-job-failure-node-0-0-vlgdn" Jul 28 16:45:54.035791 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:45:54.035762 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5d6v\" (UniqueName: \"kubernetes.io/projected/08f6a004-feb7-48a7-a076-31a435bfcd0a-kube-api-access-n5d6v\") pod \"progression-job-failure-node-0-0-vlgdn\" (UID: \"08f6a004-feb7-48a7-a076-31a435bfcd0a\") " pod="rhai-e2e-progression-42db9/progression-job-failure-node-0-0-vlgdn" Jul 28 16:45:54.044768 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:45:54.044743 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5d6v\" (UniqueName: \"kubernetes.io/projected/08f6a004-feb7-48a7-a076-31a435bfcd0a-kube-api-access-n5d6v\") pod \"progression-job-failure-node-0-0-vlgdn\" (UID: \"08f6a004-feb7-48a7-a076-31a435bfcd0a\") " pod="rhai-e2e-progression-42db9/progression-job-failure-node-0-0-vlgdn" Jul 28 16:45:54.140136 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:45:54.140052 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-42db9/progression-job-failure-node-0-0-vlgdn" Jul 28 16:45:54.264477 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:45:54.264453 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-42db9/progression-job-failure-node-0-0-vlgdn"] Jul 28 16:45:54.266917 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:45:54.266891 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08f6a004_feb7_48a7_a076_31a435bfcd0a.slice/crio-0a2ea62ef6d979774acb25e7b669692b1574e2fef64bc23354bc2dde0fe21a7c WatchSource:0}: Error finding container 0a2ea62ef6d979774acb25e7b669692b1574e2fef64bc23354bc2dde0fe21a7c: Status 404 returned error can't find the container with id 0a2ea62ef6d979774acb25e7b669692b1574e2fef64bc23354bc2dde0fe21a7c Jul 28 16:45:54.794890 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:45:54.794852 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-42db9/progression-job-failure-node-0-0-vlgdn" event={"ID":"08f6a004-feb7-48a7-a076-31a435bfcd0a","Type":"ContainerStarted","Data":"0a2ea62ef6d979774acb25e7b669692b1574e2fef64bc23354bc2dde0fe21a7c"} Jul 28 16:47:02.809854 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:47:02.809810 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:47:38.200405 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:47:38.200367 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-42db9/progression-job-failure-node-0-0-vlgdn" event={"ID":"08f6a004-feb7-48a7-a076-31a435bfcd0a","Type":"ContainerStarted","Data":"3af2eaf462e0ba4a96e2d9fe8e7bf52cc7862ce7e8a7c90b95a8b5c75cb39909"} Jul 28 16:47:38.200916 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:47:38.200512 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-42db9/progression-job-failure-node-0-0-vlgdn" Jul 28 16:47:38.223264 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:47:38.223214 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-42db9/progression-job-failure-node-0-0-vlgdn" podStartSLOduration=1.5135115909999999 podStartE2EDuration="1m45.223202655s" totalImagesPullingTime="1m43.709691064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:45:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:47:38.222725958 +0000 UTC m=+707.016522237" watchObservedRunningTime="2026-07-28 16:47:38.223202655 +0000 UTC m=+707.016998931" Jul 28 16:47:40.205996 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:47:40.205971 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-42db9/progression-job-failure-node-0-0-vlgdn" Jul 28 16:47:47.204556 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:47:47.204506 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-42db9/progression-job-failure-node-0-0-vlgdn" podUID="08f6a004-feb7-48a7-a076-31a435bfcd0a" containerName="node" probeResult="failure" output="Get \"http://10.133.0.17:28080/metrics\": dial tcp 10.133.0.17:28080: connect: connection refused" Jul 28 16:47:47.231888 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:47:47.231858 2563 generic.go:356] "Generic (PLEG): container finished" podID="08f6a004-feb7-48a7-a076-31a435bfcd0a" containerID="3af2eaf462e0ba4a96e2d9fe8e7bf52cc7862ce7e8a7c90b95a8b5c75cb39909" exitCode=1 Jul 28 16:47:47.232031 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:47:47.231930 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-42db9/progression-job-failure-node-0-0-vlgdn" event={"ID":"08f6a004-feb7-48a7-a076-31a435bfcd0a","Type":"ContainerDied","Data":"3af2eaf462e0ba4a96e2d9fe8e7bf52cc7862ce7e8a7c90b95a8b5c75cb39909"} Jul 28 16:47:48.357640 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:47:48.357603 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-42db9/progression-job-failure-node-0-0-vlgdn" Jul 28 16:47:48.466552 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:47:48.466514 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5d6v\" (UniqueName: \"kubernetes.io/projected/08f6a004-feb7-48a7-a076-31a435bfcd0a-kube-api-access-n5d6v\") pod \"08f6a004-feb7-48a7-a076-31a435bfcd0a\" (UID: \"08f6a004-feb7-48a7-a076-31a435bfcd0a\") " Jul 28 16:47:48.468792 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:47:48.468768 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08f6a004-feb7-48a7-a076-31a435bfcd0a-kube-api-access-n5d6v" (OuterVolumeSpecName: "kube-api-access-n5d6v") pod "08f6a004-feb7-48a7-a076-31a435bfcd0a" (UID: "08f6a004-feb7-48a7-a076-31a435bfcd0a"). InnerVolumeSpecName "kube-api-access-n5d6v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 16:47:48.567538 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:47:48.567501 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5d6v\" (UniqueName: \"kubernetes.io/projected/08f6a004-feb7-48a7-a076-31a435bfcd0a-kube-api-access-n5d6v\") on node \"ip-10-0-140-245.ec2.internal\" DevicePath \"\"" Jul 28 16:47:49.240891 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:47:49.240854 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-42db9/progression-job-failure-node-0-0-vlgdn" event={"ID":"08f6a004-feb7-48a7-a076-31a435bfcd0a","Type":"ContainerDied","Data":"0a2ea62ef6d979774acb25e7b669692b1574e2fef64bc23354bc2dde0fe21a7c"} Jul 28 16:47:49.240891 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:47:49.240874 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-42db9/progression-job-failure-node-0-0-vlgdn" Jul 28 16:47:49.240891 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:47:49.240897 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0a2ea62ef6d979774acb25e7b669692b1574e2fef64bc23354bc2dde0fe21a7c" Jul 28 16:47:49.862485 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:47:49.862447 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:48:01.974731 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:48:01.974700 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:48:02.773391 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:48:02.773358 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:48:02.839995 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:48:02.839960 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:48:06.990563 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:48:06.990529 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-42db9/progression-job-failure-node-0-0-vlgdn"] Jul 28 16:48:06.993887 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:48:06.993863 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-42db9/progression-job-failure-node-0-0-vlgdn"] Jul 28 16:48:07.561438 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:48:07.561407 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:48:07.661178 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:48:07.661142 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:48:07.727891 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:48:07.727862 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08f6a004-feb7-48a7-a076-31a435bfcd0a" path="/var/lib/kubelet/pods/08f6a004-feb7-48a7-a076-31a435bfcd0a/volumes" Jul 28 16:48:07.961708 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:48:07.961628 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:48:13.281068 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:48:13.281038 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:48:13.342299 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:48:13.342263 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:48:57.126223 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:48:57.126189 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:48:57.291244 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:48:57.291208 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:48:57.351683 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:48:57.351652 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:48:59.851025 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:48:59.850997 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fdgv8_6bf1d484-4b82-487c-bcf1-be189dabfd24/global-pull-secret-syncer/0.log" Jul 28 16:48:59.970453 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:48:59.970427 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" Jul 28 16:49:00.094216 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:00.094183 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-245.ec2.internal_538e10424abd3b03414a01fd5ea53009/haproxy/0.log" Jul 28 16:49:02.683489 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:02.683453 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:49:02.784405 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:02.784365 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pwcjg_258401ce-b809-4fe8-8c76-f64168a32d6e/konnectivity-agent/0.log" limit=1024 Jul 28 16:49:04.309587 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:04.309535 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9rmk2_3a7d81a8-12af-406b-9fcf-5510d483ae61/node-exporter/0.log" Jul 28 16:49:04.335629 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:04.335587 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9rmk2_3a7d81a8-12af-406b-9fcf-5510d483ae61/kube-rbac-proxy/0.log" Jul 28 16:49:04.364628 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:04.364580 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9rmk2_3a7d81a8-12af-406b-9fcf-5510d483ae61/init-textfile/0.log" Jul 28 16:49:07.223875 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:07.223838 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-86dfb8f774-885mg_a88197ff-18e4-4111-a646-24907673c012/console/0.log" Jul 28 16:49:07.303191 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:07.303162 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ndr5k/perf-node-gather-daemonset-dp75q"] Jul 28 16:49:07.303444 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:07.303430 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08f6a004-feb7-48a7-a076-31a435bfcd0a" containerName="node" Jul 28 16:49:07.303495 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:07.303447 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="08f6a004-feb7-48a7-a076-31a435bfcd0a" containerName="node" Jul 28 16:49:07.303539 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:07.303514 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="08f6a004-feb7-48a7-a076-31a435bfcd0a" containerName="node" Jul 28 16:49:07.305457 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:07.305438 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ndr5k/perf-node-gather-daemonset-dp75q" Jul 28 16:49:07.308378 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:07.308340 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ndr5k\"/\"default-dockercfg-lfbpn\"" Jul 28 16:49:07.309512 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:07.309493 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ndr5k\"/\"openshift-service-ca.crt\"" Jul 28 16:49:07.309681 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:07.309554 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ndr5k\"/\"kube-root-ca.crt\"" Jul 28 16:49:07.316674 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:07.316652 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ndr5k/perf-node-gather-daemonset-dp75q"] Jul 28 16:49:07.440073 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:07.440031 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/caf2fc4c-24c6-4527-9a49-f6b4f807431d-sys\") pod \"perf-node-gather-daemonset-dp75q\" (UID: \"caf2fc4c-24c6-4527-9a49-f6b4f807431d\") " pod="openshift-must-gather-ndr5k/perf-node-gather-daemonset-dp75q" Jul 28 16:49:07.440073 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:07.440071 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/caf2fc4c-24c6-4527-9a49-f6b4f807431d-proc\") pod \"perf-node-gather-daemonset-dp75q\" (UID: \"caf2fc4c-24c6-4527-9a49-f6b4f807431d\") " pod="openshift-must-gather-ndr5k/perf-node-gather-daemonset-dp75q" Jul 28 16:49:07.440299 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:07.440091 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/caf2fc4c-24c6-4527-9a49-f6b4f807431d-podres\") pod \"perf-node-gather-daemonset-dp75q\" (UID: \"caf2fc4c-24c6-4527-9a49-f6b4f807431d\") " pod="openshift-must-gather-ndr5k/perf-node-gather-daemonset-dp75q" Jul 28 16:49:07.440299 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:07.440193 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/caf2fc4c-24c6-4527-9a49-f6b4f807431d-lib-modules\") pod \"perf-node-gather-daemonset-dp75q\" (UID: \"caf2fc4c-24c6-4527-9a49-f6b4f807431d\") " pod="openshift-must-gather-ndr5k/perf-node-gather-daemonset-dp75q" Jul 28 16:49:07.440299 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:07.440237 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64hv2\" (UniqueName: \"kubernetes.io/projected/caf2fc4c-24c6-4527-9a49-f6b4f807431d-kube-api-access-64hv2\") pod \"perf-node-gather-daemonset-dp75q\" (UID: \"caf2fc4c-24c6-4527-9a49-f6b4f807431d\") " pod="openshift-must-gather-ndr5k/perf-node-gather-daemonset-dp75q" Jul 28 16:49:07.541098 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:07.541067 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/caf2fc4c-24c6-4527-9a49-f6b4f807431d-lib-modules\") pod \"perf-node-gather-daemonset-dp75q\" (UID: \"caf2fc4c-24c6-4527-9a49-f6b4f807431d\") " pod="openshift-must-gather-ndr5k/perf-node-gather-daemonset-dp75q" Jul 28 16:49:07.541280 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:07.541117 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64hv2\" (UniqueName: \"kubernetes.io/projected/caf2fc4c-24c6-4527-9a49-f6b4f807431d-kube-api-access-64hv2\") pod \"perf-node-gather-daemonset-dp75q\" (UID: \"caf2fc4c-24c6-4527-9a49-f6b4f807431d\") " pod="openshift-must-gather-ndr5k/perf-node-gather-daemonset-dp75q" Jul 28 16:49:07.541280 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:07.541150 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/caf2fc4c-24c6-4527-9a49-f6b4f807431d-sys\") pod \"perf-node-gather-daemonset-dp75q\" (UID: \"caf2fc4c-24c6-4527-9a49-f6b4f807431d\") " pod="openshift-must-gather-ndr5k/perf-node-gather-daemonset-dp75q" Jul 28 16:49:07.541280 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:07.541189 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/caf2fc4c-24c6-4527-9a49-f6b4f807431d-proc\") pod \"perf-node-gather-daemonset-dp75q\" (UID: \"caf2fc4c-24c6-4527-9a49-f6b4f807431d\") " pod="openshift-must-gather-ndr5k/perf-node-gather-daemonset-dp75q" Jul 28 16:49:07.541280 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:07.541210 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/caf2fc4c-24c6-4527-9a49-f6b4f807431d-podres\") pod \"perf-node-gather-daemonset-dp75q\" (UID: \"caf2fc4c-24c6-4527-9a49-f6b4f807431d\") " pod="openshift-must-gather-ndr5k/perf-node-gather-daemonset-dp75q" Jul 28 16:49:07.541280 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:07.541269 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/caf2fc4c-24c6-4527-9a49-f6b4f807431d-lib-modules\") pod \"perf-node-gather-daemonset-dp75q\" (UID: \"caf2fc4c-24c6-4527-9a49-f6b4f807431d\") " pod="openshift-must-gather-ndr5k/perf-node-gather-daemonset-dp75q" Jul 28 16:49:07.541462 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:07.541286 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/caf2fc4c-24c6-4527-9a49-f6b4f807431d-proc\") pod \"perf-node-gather-daemonset-dp75q\" (UID: \"caf2fc4c-24c6-4527-9a49-f6b4f807431d\") " pod="openshift-must-gather-ndr5k/perf-node-gather-daemonset-dp75q" Jul 28 16:49:07.541462 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:07.541273 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/caf2fc4c-24c6-4527-9a49-f6b4f807431d-sys\") pod \"perf-node-gather-daemonset-dp75q\" (UID: \"caf2fc4c-24c6-4527-9a49-f6b4f807431d\") " pod="openshift-must-gather-ndr5k/perf-node-gather-daemonset-dp75q" Jul 28 16:49:07.541462 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:07.541308 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/caf2fc4c-24c6-4527-9a49-f6b4f807431d-podres\") pod \"perf-node-gather-daemonset-dp75q\" (UID: \"caf2fc4c-24c6-4527-9a49-f6b4f807431d\") " pod="openshift-must-gather-ndr5k/perf-node-gather-daemonset-dp75q" Jul 28 16:49:07.550402 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:07.550373 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64hv2\" (UniqueName: \"kubernetes.io/projected/caf2fc4c-24c6-4527-9a49-f6b4f807431d-kube-api-access-64hv2\") pod \"perf-node-gather-daemonset-dp75q\" (UID: \"caf2fc4c-24c6-4527-9a49-f6b4f807431d\") " pod="openshift-must-gather-ndr5k/perf-node-gather-daemonset-dp75q" Jul 28 16:49:07.615533 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:07.615497 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ndr5k/perf-node-gather-daemonset-dp75q" Jul 28 16:49:07.744014 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:07.743985 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ndr5k/perf-node-gather-daemonset-dp75q"] Jul 28 16:49:07.747960 ip-10-0-140-245 kubenswrapper[2563]: W0728 16:49:07.747934 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcaf2fc4c_24c6_4527_9a49_f6b4f807431d.slice/crio-a657decb567b9ded09d325ddaf79b96d84e6a8190484a1ccc85dda1986053a1c WatchSource:0}: Error finding container a657decb567b9ded09d325ddaf79b96d84e6a8190484a1ccc85dda1986053a1c: Status 404 returned error can't find the container with id a657decb567b9ded09d325ddaf79b96d84e6a8190484a1ccc85dda1986053a1c Jul 28 16:49:08.506116 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:08.506079 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ndr5k/perf-node-gather-daemonset-dp75q" event={"ID":"caf2fc4c-24c6-4527-9a49-f6b4f807431d","Type":"ContainerStarted","Data":"ede77060f472dba89670c40732ff13678f331343ba90845298bef08f47a080c2"} Jul 28 16:49:08.506535 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:08.506133 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ndr5k/perf-node-gather-daemonset-dp75q" event={"ID":"caf2fc4c-24c6-4527-9a49-f6b4f807431d","Type":"ContainerStarted","Data":"a657decb567b9ded09d325ddaf79b96d84e6a8190484a1ccc85dda1986053a1c"} Jul 28 16:49:08.506535 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:08.506204 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ndr5k/perf-node-gather-daemonset-dp75q" Jul 28 16:49:08.523052 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:08.522384 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ndr5k/perf-node-gather-daemonset-dp75q" podStartSLOduration=1.522364371 podStartE2EDuration="1.522364371s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 16:49:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:49:08.521596686 +0000 UTC m=+797.315393179" watchObservedRunningTime="2026-07-28 16:49:08.522364371 +0000 UTC m=+797.316160648" Jul 28 16:49:08.602729 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:08.602702 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gklwd_cbe94e0b-c8db-4021-bcaa-6667f1fa992a/dns/0.log" Jul 28 16:49:08.623620 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:08.623582 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gklwd_cbe94e0b-c8db-4021-bcaa-6667f1fa992a/kube-rbac-proxy/0.log" Jul 28 16:49:08.693706 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:08.693679 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xr8r8_f0f2ba44-e234-4d76-9d0d-a152fd55e253/dns-node-resolver/0.log" Jul 28 16:49:09.119058 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:09.119032 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4899s_2613b1fa-f3a0-4a1b-a90c-029c1a1dae6d/node-ca/0.log" Jul 28 16:49:10.165142 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:10.165115 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zf2hl_632689f6-279a-4633-8bf2-f96c110383df/serve-healthcheck-canary/0.log" Jul 28 16:49:10.601921 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:10.601892 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dcjrq_73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9/kube-rbac-proxy/0.log" Jul 28 16:49:10.622778 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:10.622750 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dcjrq_73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9/exporter/0.log" Jul 28 16:49:10.642172 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:10.642147 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dcjrq_73e97b8c-9c8e-4a4c-ab88-66fa0e85ede9/extractor/0.log" Jul 28 16:49:12.270875 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:12.270845 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-controller-manager-579497545c-q2stn_1057acb3-819f-4dbc-b7e3-785c5528e735/manager/0.log" Jul 28 16:49:14.519215 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:14.519134 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ndr5k/perf-node-gather-daemonset-dp75q" Jul 28 16:49:16.659332 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:16.659301 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4zxv6_eb488c90-4340-45eb-bb7b-003ef9ca81d1/kube-multus-additional-cni-plugins/0.log" Jul 28 16:49:16.682225 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:16.682153 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4zxv6_eb488c90-4340-45eb-bb7b-003ef9ca81d1/egress-router-binary-copy/0.log" Jul 28 16:49:16.707454 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:16.707428 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4zxv6_eb488c90-4340-45eb-bb7b-003ef9ca81d1/cni-plugins/0.log" Jul 28 16:49:16.729392 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:16.729371 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4zxv6_eb488c90-4340-45eb-bb7b-003ef9ca81d1/bond-cni-plugin/0.log" Jul 28 16:49:16.754369 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:16.754348 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4zxv6_eb488c90-4340-45eb-bb7b-003ef9ca81d1/routeoverride-cni/0.log" Jul 28 16:49:16.779254 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:16.779229 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4zxv6_eb488c90-4340-45eb-bb7b-003ef9ca81d1/whereabouts-cni-bincopy/0.log" Jul 28 16:49:16.805881 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:16.805866 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4zxv6_eb488c90-4340-45eb-bb7b-003ef9ca81d1/whereabouts-cni/0.log" Jul 28 16:49:17.167478 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:17.167455 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-q82xs_6ba0ffc7-9736-4f5e-86de-52a97b2a17e7/kube-multus/0.log" Jul 28 16:49:17.250281 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:17.250254 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-q6dz7_da54b8f0-8ec1-4b28-a76b-037edb5bec20/network-metrics-daemon/0.log" Jul 28 16:49:17.269326 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:17.269297 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-q6dz7_da54b8f0-8ec1-4b28-a76b-037edb5bec20/kube-rbac-proxy/0.log" Jul 28 16:49:18.537342 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:18.537312 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vjvs7_021148b1-76cd-486f-a99d-e45527a9323e/ovn-controller/0.log" Jul 28 16:49:18.558504 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:18.558483 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vjvs7_021148b1-76cd-486f-a99d-e45527a9323e/ovn-acl-logging/1.log" Jul 28 16:49:18.558661 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:18.558515 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vjvs7_021148b1-76cd-486f-a99d-e45527a9323e/ovn-acl-logging/0.log" Jul 28 16:49:18.574998 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:18.574976 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vjvs7_021148b1-76cd-486f-a99d-e45527a9323e/kube-rbac-proxy-node/0.log" Jul 28 16:49:18.595149 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:18.595123 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vjvs7_021148b1-76cd-486f-a99d-e45527a9323e/kube-rbac-proxy-ovn-metrics/0.log" Jul 28 16:49:18.614543 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:18.614517 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vjvs7_021148b1-76cd-486f-a99d-e45527a9323e/northd/0.log" Jul 28 16:49:18.636123 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:18.636098 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vjvs7_021148b1-76cd-486f-a99d-e45527a9323e/nbdb/0.log" Jul 28 16:49:18.656308 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:18.656283 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vjvs7_021148b1-76cd-486f-a99d-e45527a9323e/sbdb/0.log" Jul 28 16:49:18.689988 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:18.689961 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vjvs7_021148b1-76cd-486f-a99d-e45527a9323e/ovnkube-controller/0.log" Jul 28 16:49:19.724758 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:19.724730 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-wq5zz_45e07f9b-6993-4b7d-bf17-197b21c25a4b/network-check-target-container/0.log" Jul 28 16:49:20.693253 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:20.693226 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-shk5x_3f9f655d-f123-4c01-ab93-61377299680a/iptables-alerter/0.log" Jul 28 16:49:21.311377 ip-10-0-140-245 kubenswrapper[2563]: I0728 16:49:21.311348 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-kwxqv_90ae3dbc-89ae-4464-b7db-3152c533ee19/tuned/0.log"