Jul 27 15:51:48.278412 ip-10-0-142-4 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 27 15:51:48.278423 ip-10-0-142-4 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 27 15:51:48.278432 ip-10-0-142-4 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 27 15:51:48.278774 ip-10-0-142-4 systemd[1]: Failed to start Kubernetes Kubelet. Jul 27 15:51:58.379801 ip-10-0-142-4 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 27 15:51:58.379826 ip-10-0-142-4 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 0345e5e568054fea9c2719d689668877 -- Jul 27 15:53:49.107119 ip-10-0-142-4 systemd[1]: Starting Kubernetes Kubelet... Jul 27 15:53:49.420748 ip-10-0-142-4 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 27 15:53:49.420748 ip-10-0-142-4 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 27 15:53:49.420748 ip-10-0-142-4 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 27 15:53:49.420748 ip-10-0-142-4 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 27 15:53:49.420748 ip-10-0-142-4 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 27 15:53:49.422608 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.422513 2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 27 15:53:49.426009 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.425994 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 15:53:49.426009 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426009 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 15:53:49.426076 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426013 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 27 15:53:49.426076 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426016 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 15:53:49.426076 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426025 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 15:53:49.426076 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426028 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 15:53:49.426076 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426031 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 15:53:49.426076 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426036 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 15:53:49.426076 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426041 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 15:53:49.426076 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426045 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 15:53:49.426076 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426049 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 15:53:49.426076 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426052 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 15:53:49.426076 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426056 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 15:53:49.426076 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426058 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 15:53:49.426076 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426062 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 15:53:49.426076 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426065 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 15:53:49.426076 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426068 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 15:53:49.426076 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426071 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 15:53:49.426076 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426073 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 15:53:49.426076 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426076 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 15:53:49.426076 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426079 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 15:53:49.426563 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426081 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 15:53:49.426563 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426084 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 15:53:49.426563 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426087 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 15:53:49.426563 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426090 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 15:53:49.426563 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426093 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 15:53:49.426563 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426095 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 15:53:49.426563 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426097 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 15:53:49.426563 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426100 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 15:53:49.426563 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426103 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 15:53:49.426563 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426105 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 15:53:49.426563 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426108 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 15:53:49.426563 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426111 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 15:53:49.426563 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426113 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 15:53:49.426563 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426116 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 15:53:49.426563 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426119 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 15:53:49.426563 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426121 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 15:53:49.426563 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426124 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 15:53:49.426563 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426127 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 15:53:49.426563 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426129 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 15:53:49.426563 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426132 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 15:53:49.427062 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426134 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 15:53:49.427062 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426136 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 15:53:49.427062 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426139 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 15:53:49.427062 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426142 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 15:53:49.427062 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426144 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 15:53:49.427062 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426147 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 15:53:49.427062 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426149 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 15:53:49.427062 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426151 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 15:53:49.427062 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426154 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 15:53:49.427062 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426158 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 15:53:49.427062 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426162 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 15:53:49.427062 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426165 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 15:53:49.427062 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426168 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 15:53:49.427062 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426171 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 15:53:49.427062 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426174 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 15:53:49.427062 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426177 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 15:53:49.427062 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426180 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 15:53:49.427062 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426182 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 15:53:49.427062 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426185 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 15:53:49.427559 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426188 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 15:53:49.427559 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426190 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 15:53:49.427559 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426193 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 15:53:49.427559 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426196 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 15:53:49.427559 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426198 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 15:53:49.427559 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426201 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 15:53:49.427559 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426203 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 15:53:49.427559 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426206 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 15:53:49.427559 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426208 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 15:53:49.427559 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426211 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 15:53:49.427559 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426214 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 15:53:49.427559 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426217 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 15:53:49.427559 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426219 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 15:53:49.427559 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426221 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 15:53:49.427559 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426224 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 15:53:49.427559 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426226 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 15:53:49.427559 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426229 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 15:53:49.427559 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426231 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 15:53:49.427559 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426234 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 15:53:49.427559 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426236 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 15:53:49.428056 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426239 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 15:53:49.428056 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426241 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 15:53:49.428056 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426243 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 15:53:49.428056 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426246 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 15:53:49.428056 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426248 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 15:53:49.428056 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426251 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 15:53:49.428056 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426255 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 15:53:49.428056 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426258 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 15:53:49.428056 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426262 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 15:53:49.428056 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426264 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 15:53:49.428056 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426267 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 15:53:49.428056 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426270 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 15:53:49.428056 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426272 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 15:53:49.428056 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426274 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 15:53:49.428056 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426277 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 15:53:49.428056 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426280 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 15:53:49.428056 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426283 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 15:53:49.428056 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426286 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 15:53:49.428056 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.426288 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 15:53:49.428056 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427601 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 15:53:49.428533 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427609 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 15:53:49.428533 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427612 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 15:53:49.428533 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427616 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 15:53:49.428533 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427622 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 15:53:49.428533 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427626 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 15:53:49.428533 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427629 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 15:53:49.428533 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427631 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 15:53:49.428533 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427634 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 15:53:49.428533 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427637 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 15:53:49.428533 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427640 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 15:53:49.428533 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427643 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 15:53:49.428533 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427645 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 15:53:49.428533 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427648 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 15:53:49.428533 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427651 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 15:53:49.428533 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427654 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 15:53:49.428533 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427656 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 15:53:49.428533 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427659 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 15:53:49.428533 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427662 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 15:53:49.428533 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427666 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 15:53:49.428533 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427669 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 15:53:49.429070 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427671 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 15:53:49.429070 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427674 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 15:53:49.429070 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427677 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 15:53:49.429070 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427679 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 15:53:49.429070 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427682 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 15:53:49.429070 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427685 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 15:53:49.429070 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427688 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 15:53:49.429070 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427691 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 15:53:49.429070 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427693 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 15:53:49.429070 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427696 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 15:53:49.429070 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427698 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 15:53:49.429070 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427701 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 15:53:49.429070 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427703 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 15:53:49.429070 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427706 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 15:53:49.429070 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427709 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 15:53:49.429070 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427712 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 15:53:49.429070 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427715 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 15:53:49.429070 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427717 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 15:53:49.429070 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427720 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 15:53:49.429070 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427723 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 15:53:49.429881 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427726 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 15:53:49.429881 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427728 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 15:53:49.429881 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427731 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 15:53:49.429881 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427733 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 15:53:49.429881 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427736 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 15:53:49.429881 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427739 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 15:53:49.429881 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427741 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 15:53:49.429881 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427745 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 15:53:49.429881 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427747 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 15:53:49.429881 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427749 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 15:53:49.429881 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427753 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 15:53:49.429881 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427755 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 15:53:49.429881 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427758 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 15:53:49.429881 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427760 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 15:53:49.429881 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427763 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 15:53:49.429881 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427766 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 15:53:49.429881 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427768 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 15:53:49.429881 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427771 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 15:53:49.429881 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427773 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 15:53:49.430543 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427776 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 15:53:49.430543 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427778 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 15:53:49.430543 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427781 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 15:53:49.430543 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427783 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 15:53:49.430543 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427786 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 15:53:49.430543 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427789 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 15:53:49.430543 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427791 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 15:53:49.430543 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427794 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 15:53:49.430543 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427810 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 15:53:49.430543 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427812 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 15:53:49.430543 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427816 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 15:53:49.430543 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427818 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 15:53:49.430543 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427822 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 15:53:49.430543 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427824 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 15:53:49.430543 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427827 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 15:53:49.430543 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427830 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 15:53:49.430543 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427833 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 15:53:49.430543 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427836 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 15:53:49.430543 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427838 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 15:53:49.430543 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427841 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 15:53:49.431075 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427844 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 15:53:49.431075 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427847 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 15:53:49.431075 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427850 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 15:53:49.431075 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427852 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 15:53:49.431075 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427857 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 15:53:49.431075 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427860 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 15:53:49.431075 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427863 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 15:53:49.431075 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427866 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 15:53:49.431075 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427869 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 15:53:49.431075 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427872 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 15:53:49.431075 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427875 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 15:53:49.431075 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427878 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 27 15:53:49.431075 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427881 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 15:53:49.431075 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427885 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 15:53:49.431075 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427888 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 15:53:49.431075 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427891 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 15:53:49.431075 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427893 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 15:53:49.431075 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427896 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 15:53:49.431075 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.427899 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 15:53:49.431566 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428284 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 15:53:49.431566 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428289 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 15:53:49.431566 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428292 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 15:53:49.431566 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428297 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 15:53:49.431566 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428300 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 15:53:49.431566 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428306 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 15:53:49.431566 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428308 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 15:53:49.431566 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428311 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 15:53:49.431566 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428314 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 15:53:49.431566 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428316 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 15:53:49.431566 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428319 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 15:53:49.431566 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428321 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 15:53:49.431566 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428324 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 15:53:49.431566 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428327 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 15:53:49.431566 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428330 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 15:53:49.431566 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428332 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 15:53:49.431566 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428335 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 15:53:49.431566 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428337 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 15:53:49.431566 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428340 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 15:53:49.431566 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428342 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 15:53:49.432082 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428345 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 15:53:49.432082 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428348 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 15:53:49.432082 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428350 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 15:53:49.432082 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428353 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 15:53:49.432082 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428355 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 27 15:53:49.432082 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428358 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 15:53:49.432082 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428360 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 15:53:49.432082 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428363 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 15:53:49.432082 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428366 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 15:53:49.432082 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428368 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 15:53:49.432082 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428371 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 15:53:49.432082 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428375 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 15:53:49.432082 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428377 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 15:53:49.432082 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428380 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 15:53:49.432082 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428383 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 15:53:49.432082 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428385 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 15:53:49.432082 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428389 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 15:53:49.432082 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428393 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 15:53:49.432082 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428396 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 15:53:49.432082 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428398 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 15:53:49.432564 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428401 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 15:53:49.432564 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428404 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 15:53:49.432564 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428407 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 15:53:49.432564 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428409 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 15:53:49.432564 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428412 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 15:53:49.432564 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428414 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 15:53:49.432564 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428417 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 15:53:49.432564 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428420 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 15:53:49.432564 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428422 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 15:53:49.432564 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428425 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 15:53:49.432564 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428427 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 15:53:49.432564 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428430 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 15:53:49.432564 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428432 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 15:53:49.432564 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428435 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 15:53:49.432564 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428438 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 15:53:49.432564 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428440 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 15:53:49.432564 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428443 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 15:53:49.432564 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428445 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 15:53:49.432564 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428449 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 15:53:49.432564 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428453 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 15:53:49.433073 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428456 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 15:53:49.433073 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428459 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 15:53:49.433073 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428462 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 15:53:49.433073 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428467 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 15:53:49.433073 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428469 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 15:53:49.433073 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428472 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 15:53:49.433073 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428475 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 15:53:49.433073 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428477 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 15:53:49.433073 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428480 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 15:53:49.433073 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428484 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 15:53:49.433073 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428487 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 15:53:49.433073 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428490 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 15:53:49.433073 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428492 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 15:53:49.433073 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428495 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 15:53:49.433073 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428497 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 15:53:49.433073 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428501 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 15:53:49.433073 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428504 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 15:53:49.433073 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428508 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 15:53:49.433073 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428511 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 15:53:49.433073 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428513 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 15:53:49.433552 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428516 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 15:53:49.433552 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428520 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 15:53:49.433552 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428523 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 15:53:49.433552 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428525 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 15:53:49.433552 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428528 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 15:53:49.433552 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428530 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 15:53:49.433552 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428533 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 15:53:49.433552 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428535 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 15:53:49.433552 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428538 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 15:53:49.433552 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428541 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 15:53:49.433552 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428543 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 15:53:49.433552 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428546 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 15:53:49.433552 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428549 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 15:53:49.433552 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428552 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 15:53:49.433552 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428554 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 15:53:49.433552 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428558 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 15:53:49.433552 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428560 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 15:53:49.433552 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428563 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 15:53:49.433552 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.428565 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 15:53:49.433552 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428642 2561 flags.go:64] FLAG: --address="0.0.0.0" Jul 27 15:53:49.434053 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428657 2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 27 15:53:49.434053 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428668 2561 flags.go:64] FLAG: --anonymous-auth="true" Jul 27 15:53:49.434053 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428674 2561 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 27 15:53:49.434053 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428678 2561 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 27 15:53:49.434053 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428682 2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 27 15:53:49.434053 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428686 2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 27 15:53:49.434053 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428691 2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 27 15:53:49.434053 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428694 2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 27 15:53:49.434053 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428697 2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 27 15:53:49.434053 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428701 2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 27 15:53:49.434053 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428704 2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 27 15:53:49.434053 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428707 2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 27 15:53:49.434053 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428710 2561 flags.go:64] FLAG: --cgroup-root="" Jul 27 15:53:49.434053 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428713 2561 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 27 15:53:49.434053 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428716 2561 flags.go:64] FLAG: --client-ca-file="" Jul 27 15:53:49.434053 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428719 2561 flags.go:64] FLAG: --cloud-provider="external" Jul 27 15:53:49.434053 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428721 2561 flags.go:64] FLAG: --cluster-dns="[]" Jul 27 15:53:49.434053 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428726 2561 flags.go:64] FLAG: --cluster-domain="" Jul 27 15:53:49.434053 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428728 2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 27 15:53:49.434053 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428731 2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 27 15:53:49.434053 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428743 2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 27 15:53:49.434053 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428747 2561 flags.go:64] FLAG: --container-log-max-files="5" Jul 27 15:53:49.434053 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428751 2561 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 27 15:53:49.434053 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428754 2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 27 15:53:49.434631 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428757 2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 27 15:53:49.434631 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428760 2561 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 27 15:53:49.434631 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428763 2561 flags.go:64] FLAG: --contention-profiling="false" Jul 27 15:53:49.434631 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428767 2561 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 27 15:53:49.434631 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428770 2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 27 15:53:49.434631 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428773 2561 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 27 15:53:49.434631 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428776 2561 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 27 15:53:49.434631 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428780 2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 27 15:53:49.434631 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428784 2561 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 27 15:53:49.434631 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428788 2561 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 27 15:53:49.434631 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428791 2561 flags.go:64] FLAG: --enable-load-reader="false" Jul 27 15:53:49.434631 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428795 2561 flags.go:64] FLAG: --enable-server="true" Jul 27 15:53:49.434631 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428812 2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 27 15:53:49.434631 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428816 2561 flags.go:64] FLAG: --event-burst="100" Jul 27 15:53:49.434631 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428820 2561 flags.go:64] FLAG: --event-qps="50" Jul 27 15:53:49.434631 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428823 2561 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 27 15:53:49.434631 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428826 2561 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 27 15:53:49.434631 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428829 2561 flags.go:64] FLAG: --eviction-hard="" Jul 27 15:53:49.434631 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428833 2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 27 15:53:49.434631 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428836 2561 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 27 15:53:49.434631 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428839 2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 27 15:53:49.434631 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428842 2561 flags.go:64] FLAG: --eviction-soft="" Jul 27 15:53:49.434631 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428845 2561 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 27 15:53:49.434631 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428848 2561 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 27 15:53:49.434631 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428851 2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 27 15:53:49.435262 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428854 2561 flags.go:64] FLAG: --experimental-mounter-path="" Jul 27 15:53:49.435262 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428857 2561 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 27 15:53:49.435262 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428860 2561 flags.go:64] FLAG: --fail-swap-on="true" Jul 27 15:53:49.435262 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428863 2561 flags.go:64] FLAG: --feature-gates="" Jul 27 15:53:49.435262 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428867 2561 flags.go:64] FLAG: --file-check-frequency="20s" Jul 27 15:53:49.435262 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428870 2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 27 15:53:49.435262 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428873 2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 27 15:53:49.435262 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428876 2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 27 15:53:49.435262 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428879 2561 flags.go:64] FLAG: --healthz-port="10248" Jul 27 15:53:49.435262 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428882 2561 flags.go:64] FLAG: --help="false" Jul 27 15:53:49.435262 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428885 2561 flags.go:64] FLAG: --hostname-override="ip-10-0-142-4.ec2.internal" Jul 27 15:53:49.435262 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428888 2561 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 27 15:53:49.435262 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428891 2561 flags.go:64] FLAG: --http-check-frequency="20s" Jul 27 15:53:49.435262 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428894 2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 27 15:53:49.435262 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428898 2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 27 15:53:49.435262 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428901 2561 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 27 15:53:49.435262 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428905 2561 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 27 15:53:49.435262 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428908 2561 flags.go:64] FLAG: --image-service-endpoint="" Jul 27 15:53:49.435262 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428911 2561 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 27 15:53:49.435262 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428915 2561 flags.go:64] FLAG: --kube-api-burst="100" Jul 27 15:53:49.435262 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428918 2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 27 15:53:49.435262 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428921 2561 flags.go:64] FLAG: --kube-api-qps="50" Jul 27 15:53:49.435262 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428924 2561 flags.go:64] FLAG: --kube-reserved="" Jul 27 15:53:49.435262 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428927 2561 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 27 15:53:49.435885 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428930 2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 27 15:53:49.435885 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428933 2561 flags.go:64] FLAG: --kubelet-cgroups="" Jul 27 15:53:49.435885 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428936 2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 27 15:53:49.435885 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428938 2561 flags.go:64] FLAG: --lock-file="" Jul 27 15:53:49.435885 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428941 2561 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 27 15:53:49.435885 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428944 2561 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 27 15:53:49.435885 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428947 2561 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 27 15:53:49.435885 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428953 2561 flags.go:64] FLAG: --log-json-split-stream="false" Jul 27 15:53:49.435885 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428955 2561 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 27 15:53:49.435885 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428959 2561 flags.go:64] FLAG: --log-text-split-stream="false" Jul 27 15:53:49.435885 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428961 2561 flags.go:64] FLAG: --logging-format="text" Jul 27 15:53:49.435885 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428964 2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 27 15:53:49.435885 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428967 2561 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 27 15:53:49.435885 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428970 2561 flags.go:64] FLAG: --manifest-url="" Jul 27 15:53:49.435885 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428973 2561 flags.go:64] FLAG: --manifest-url-header="" Jul 27 15:53:49.435885 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428979 2561 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 27 15:53:49.435885 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428981 2561 flags.go:64] FLAG: --max-open-files="1000000" Jul 27 15:53:49.435885 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428986 2561 flags.go:64] FLAG: --max-pods="110" Jul 27 15:53:49.435885 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428989 2561 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 27 15:53:49.435885 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428992 2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 27 15:53:49.435885 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428995 2561 flags.go:64] FLAG: --memory-manager-policy="None" Jul 27 15:53:49.435885 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.428998 2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 27 15:53:49.435885 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.429001 2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 27 15:53:49.435885 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.429004 2561 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 27 15:53:49.435885 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.429008 2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 27 15:53:49.436496 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.429015 2561 flags.go:64] FLAG: --node-status-max-images="50" Jul 27 15:53:49.436496 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.429019 2561 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 27 15:53:49.436496 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.429022 2561 flags.go:64] FLAG: --oom-score-adj="-999" Jul 27 15:53:49.436496 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.429025 2561 flags.go:64] FLAG: --pod-cidr="" Jul 27 15:53:49.436496 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.429028 2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 27 15:53:49.436496 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.429034 2561 flags.go:64] FLAG: --pod-manifest-path="" Jul 27 15:53:49.436496 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.429037 2561 flags.go:64] FLAG: --pod-max-pids="-1" Jul 27 15:53:49.436496 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.429040 2561 flags.go:64] FLAG: --pods-per-core="0" Jul 27 15:53:49.436496 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.429043 2561 flags.go:64] FLAG: --port="10250" Jul 27 15:53:49.436496 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.429046 2561 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 27 15:53:49.436496 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.429049 2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-027509fb4e736e115" Jul 27 15:53:49.436496 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.429052 2561 flags.go:64] FLAG: --qos-reserved="" Jul 27 15:53:49.436496 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.429055 2561 flags.go:64] FLAG: --read-only-port="10255" Jul 27 15:53:49.436496 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.429058 2561 flags.go:64] FLAG: --register-node="true" Jul 27 15:53:49.436496 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.429061 2561 flags.go:64] FLAG: --register-with-taints="" Jul 27 15:53:49.436496 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.429065 2561 flags.go:64] FLAG: --registry-burst="10" Jul 27 15:53:49.436496 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.429068 2561 flags.go:64] FLAG: --registry-qps="5" Jul 27 15:53:49.436496 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.429071 2561 flags.go:64] FLAG: --reserved-cpus="" Jul 27 15:53:49.436496 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.429074 2561 flags.go:64] FLAG: --reserved-memory="" Jul 27 15:53:49.436496 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.429078 2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 27 15:53:49.436496 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.429081 2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 27 15:53:49.436496 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.429085 2561 flags.go:64] FLAG: --rotate-certificates="false" Jul 27 15:53:49.436496 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.429088 2561 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 27 15:53:49.436496 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.429090 2561 flags.go:64] FLAG: --runonce="false" Jul 27 15:53:49.436496 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.429094 2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 27 15:53:49.437126 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.429098 2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 27 15:53:49.437126 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.429101 2561 flags.go:64] FLAG: --seccomp-default="false" Jul 27 15:53:49.437126 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.429104 2561 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 27 15:53:49.437126 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.429107 2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 27 15:53:49.437126 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.429110 2561 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 27 15:53:49.437126 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.429113 2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 27 15:53:49.437126 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.429116 2561 flags.go:64] FLAG: --storage-driver-password="root" Jul 27 15:53:49.437126 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.429120 2561 flags.go:64] FLAG: --storage-driver-secure="false" Jul 27 15:53:49.437126 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.429123 2561 flags.go:64] FLAG: --storage-driver-table="stats" Jul 27 15:53:49.437126 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.429125 2561 flags.go:64] FLAG: --storage-driver-user="root" Jul 27 15:53:49.437126 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.429128 2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 27 15:53:49.437126 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.429132 2561 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 27 15:53:49.437126 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.429134 2561 flags.go:64] FLAG: --system-cgroups="" Jul 27 15:53:49.437126 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.429137 2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 27 15:53:49.437126 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.429143 2561 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 27 15:53:49.437126 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.429145 2561 flags.go:64] FLAG: --tls-cert-file="" Jul 27 15:53:49.437126 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.429148 2561 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 27 15:53:49.437126 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.429152 2561 flags.go:64] FLAG: --tls-min-version="" Jul 27 15:53:49.437126 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.429155 2561 flags.go:64] FLAG: --tls-private-key-file="" Jul 27 15:53:49.437126 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.429157 2561 flags.go:64] FLAG: --topology-manager-policy="none" Jul 27 15:53:49.437126 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.429160 2561 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 27 15:53:49.437126 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.429163 2561 flags.go:64] FLAG: --topology-manager-scope="container" Jul 27 15:53:49.437126 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.429166 2561 flags.go:64] FLAG: --v="2" Jul 27 15:53:49.437126 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.429170 2561 flags.go:64] FLAG: --version="false" Jul 27 15:53:49.437126 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.429174 2561 flags.go:64] FLAG: --vmodule="" Jul 27 15:53:49.437772 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.429178 2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 27 15:53:49.437772 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.429181 2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 27 15:53:49.437772 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429586 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 15:53:49.437772 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429598 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 15:53:49.437772 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429603 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 15:53:49.437772 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429609 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 15:53:49.437772 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429614 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 15:53:49.437772 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429628 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 15:53:49.437772 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429633 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 15:53:49.437772 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429638 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 15:53:49.437772 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429643 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 15:53:49.437772 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429647 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 15:53:49.437772 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429652 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 15:53:49.437772 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429656 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 15:53:49.437772 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429661 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 15:53:49.437772 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429665 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 15:53:49.437772 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429670 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 15:53:49.437772 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429674 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 15:53:49.437772 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429678 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 15:53:49.437772 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429686 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 15:53:49.438296 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429697 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 15:53:49.438296 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429702 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 15:53:49.438296 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429707 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 15:53:49.438296 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429711 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 15:53:49.438296 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429716 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 15:53:49.438296 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429721 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 15:53:49.438296 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429725 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 15:53:49.438296 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429729 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 15:53:49.438296 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429734 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 15:53:49.438296 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429738 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 15:53:49.438296 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429743 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 15:53:49.438296 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429746 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 15:53:49.438296 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429751 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 15:53:49.438296 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429760 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 15:53:49.438296 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429765 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 15:53:49.438296 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429769 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 15:53:49.438296 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429773 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 15:53:49.438296 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429777 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 15:53:49.438296 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429782 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 15:53:49.438296 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429788 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 15:53:49.438786 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429792 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 15:53:49.438786 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429810 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 15:53:49.438786 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429816 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 15:53:49.438786 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429820 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 15:53:49.438786 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429824 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 15:53:49.438786 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429833 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 15:53:49.438786 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429837 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 15:53:49.438786 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429842 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 15:53:49.438786 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429846 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 15:53:49.438786 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429850 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 15:53:49.438786 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429854 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 15:53:49.438786 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429858 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 15:53:49.438786 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429864 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 15:53:49.438786 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429869 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 15:53:49.438786 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429873 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 15:53:49.438786 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429878 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 15:53:49.438786 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429883 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 15:53:49.438786 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429897 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 15:53:49.438786 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429908 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 15:53:49.439344 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429913 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 15:53:49.439344 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429917 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 15:53:49.439344 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429922 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 15:53:49.439344 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429926 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 15:53:49.439344 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429930 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 27 15:53:49.439344 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429935 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 15:53:49.439344 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429940 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 15:53:49.439344 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429944 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 15:53:49.439344 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429948 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 15:53:49.439344 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429953 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 15:53:49.439344 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429957 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 15:53:49.439344 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429966 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 15:53:49.439344 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429973 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 15:53:49.439344 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429977 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 15:53:49.439344 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429982 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 15:53:49.439344 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429987 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 15:53:49.439344 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429991 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 15:53:49.439344 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429995 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 15:53:49.439344 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.429999 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 15:53:49.439849 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.430003 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 15:53:49.439849 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.430009 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 15:53:49.439849 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.430013 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 15:53:49.439849 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.430018 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 15:53:49.439849 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.430026 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 15:53:49.439849 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.430031 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 15:53:49.439849 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.430035 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 15:53:49.439849 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.430041 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 15:53:49.439849 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.430045 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 15:53:49.439849 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.430049 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 15:53:49.439849 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.430054 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 15:53:49.439849 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.430058 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 15:53:49.439849 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.430063 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 15:53:49.439849 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.430067 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 15:53:49.439849 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.430071 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 15:53:49.439849 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.430076 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 15:53:49.439849 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.430080 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 15:53:49.439849 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.430089 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 15:53:49.439849 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.430094 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 15:53:49.439849 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.430098 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 15:53:49.440334 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.430102 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 15:53:49.440334 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.430108 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 15:53:49.440334 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.430115 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 15:53:49.440334 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.431071 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 27 15:53:49.440334 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.439472 2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 27 15:53:49.440334 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.439490 2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 27 15:53:49.440334 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.439512 2561 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 27 15:53:49.440334 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.439518 2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 27 15:53:49.440334 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439581 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 15:53:49.440334 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439587 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 15:53:49.440334 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439590 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 15:53:49.440334 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439593 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 15:53:49.440334 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439596 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 15:53:49.440334 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439599 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 15:53:49.440695 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439602 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 15:53:49.440695 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439605 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 15:53:49.440695 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439607 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 15:53:49.440695 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439610 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 15:53:49.440695 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439613 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 15:53:49.440695 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439616 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 15:53:49.440695 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439619 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 15:53:49.440695 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439621 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 15:53:49.440695 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439624 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 15:53:49.440695 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439627 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 15:53:49.440695 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439630 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 15:53:49.440695 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439632 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 15:53:49.440695 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439635 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 15:53:49.440695 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439638 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 15:53:49.440695 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439640 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 15:53:49.440695 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439643 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 15:53:49.440695 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439645 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 15:53:49.440695 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439647 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 15:53:49.440695 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439650 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 15:53:49.440695 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439653 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 15:53:49.441197 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439655 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 15:53:49.441197 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439658 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 15:53:49.441197 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439661 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 15:53:49.441197 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439665 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 15:53:49.441197 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439667 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 15:53:49.441197 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439670 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 15:53:49.441197 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439673 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 15:53:49.441197 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439677 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 15:53:49.441197 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439680 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 15:53:49.441197 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439684 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 15:53:49.441197 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439686 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 15:53:49.441197 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439689 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 15:53:49.441197 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439691 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 15:53:49.441197 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439694 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 15:53:49.441197 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439698 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 15:53:49.441197 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439701 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 15:53:49.441197 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439705 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 15:53:49.441197 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439708 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 15:53:49.441197 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439711 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 15:53:49.441656 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439714 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 15:53:49.441656 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439717 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 15:53:49.441656 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439720 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 15:53:49.441656 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439723 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 15:53:49.441656 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439726 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 15:53:49.441656 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439729 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 15:53:49.441656 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439731 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 15:53:49.441656 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439734 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 15:53:49.441656 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439736 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 15:53:49.441656 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439739 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 15:53:49.441656 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439741 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 15:53:49.441656 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439744 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 15:53:49.441656 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439746 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 15:53:49.441656 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439749 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 15:53:49.441656 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439752 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 15:53:49.441656 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439755 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 15:53:49.441656 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439758 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 15:53:49.441656 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439761 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 15:53:49.441656 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439764 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 27 15:53:49.441656 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439767 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 15:53:49.442169 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439769 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 15:53:49.442169 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439772 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 15:53:49.442169 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439774 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 15:53:49.442169 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439777 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 15:53:49.442169 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439780 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 15:53:49.442169 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439782 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 15:53:49.442169 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439785 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 15:53:49.442169 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439787 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 15:53:49.442169 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439790 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 15:53:49.442169 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439792 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 15:53:49.442169 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439795 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 15:53:49.442169 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439812 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 15:53:49.442169 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439816 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 15:53:49.442169 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439818 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 15:53:49.442169 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439822 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 15:53:49.442169 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439825 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 15:53:49.442169 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439828 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 15:53:49.442169 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439830 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 15:53:49.442169 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439834 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 15:53:49.442169 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439837 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 15:53:49.442662 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439840 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 15:53:49.442662 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439843 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 15:53:49.442662 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439846 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 15:53:49.442662 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439848 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 15:53:49.442662 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439851 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 15:53:49.442662 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439853 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 15:53:49.442662 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439857 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 15:53:49.442662 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439861 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 15:53:49.442662 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439864 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 15:53:49.442662 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439866 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 15:53:49.442662 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439869 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 15:53:49.442662 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439872 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 15:53:49.442662 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439874 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 15:53:49.442662 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.439877 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 15:53:49.442662 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.439882 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 27 15:53:49.443078 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440009 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 15:53:49.443078 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440015 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 15:53:49.443078 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440019 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 15:53:49.443078 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440022 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 15:53:49.443078 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440025 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 15:53:49.443078 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440028 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 15:53:49.443078 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440030 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 15:53:49.443078 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440034 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 15:53:49.443078 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440036 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 15:53:49.443078 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440039 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 15:53:49.443078 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440042 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 15:53:49.443078 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440044 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 15:53:49.443078 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440048 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 15:53:49.443078 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440050 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 15:53:49.443078 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440053 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 15:53:49.443078 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440055 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 15:53:49.443078 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440058 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 15:53:49.443078 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440060 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 15:53:49.443078 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440063 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 15:53:49.443078 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440066 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 15:53:49.443559 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440068 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 15:53:49.443559 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440070 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 15:53:49.443559 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440073 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 15:53:49.443559 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440076 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 15:53:49.443559 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440078 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 15:53:49.443559 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440081 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 15:53:49.443559 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440084 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 15:53:49.443559 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440086 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 15:53:49.443559 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440089 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 15:53:49.443559 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440093 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 15:53:49.443559 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440097 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 15:53:49.443559 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440100 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 15:53:49.443559 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440103 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 15:53:49.443559 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440106 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 15:53:49.443559 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440108 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 15:53:49.443559 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440111 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 15:53:49.443559 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440113 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 15:53:49.443559 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440116 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 15:53:49.443559 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440119 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 15:53:49.443559 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440122 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 15:53:49.444071 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440125 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 15:53:49.444071 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440127 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 15:53:49.444071 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440131 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 15:53:49.444071 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440134 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 15:53:49.444071 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440138 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 15:53:49.444071 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440141 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 15:53:49.444071 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440143 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 15:53:49.444071 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440146 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 15:53:49.444071 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440148 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 15:53:49.444071 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440151 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 15:53:49.444071 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440154 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 15:53:49.444071 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440157 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 15:53:49.444071 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440160 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 15:53:49.444071 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440162 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 15:53:49.444071 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440165 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 15:53:49.444071 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440168 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 15:53:49.444071 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440171 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 15:53:49.444071 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440173 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 15:53:49.444071 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440176 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 15:53:49.444528 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440178 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 15:53:49.444528 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440181 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 15:53:49.444528 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440184 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 15:53:49.444528 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440187 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 15:53:49.444528 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440189 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 15:53:49.444528 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440191 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 15:53:49.444528 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440194 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 15:53:49.444528 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440197 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 15:53:49.444528 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440199 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 15:53:49.444528 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440202 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 15:53:49.444528 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440204 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 15:53:49.444528 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440207 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 15:53:49.444528 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440210 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 15:53:49.444528 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440212 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 15:53:49.444528 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440215 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 15:53:49.444528 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440217 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 15:53:49.444528 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440220 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 15:53:49.444528 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440222 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 15:53:49.444528 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440225 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 15:53:49.444528 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440228 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 15:53:49.445028 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440231 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 15:53:49.445028 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440233 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 15:53:49.445028 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440236 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 15:53:49.445028 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440238 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 15:53:49.445028 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440241 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 15:53:49.445028 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440243 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 15:53:49.445028 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440246 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 15:53:49.445028 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440248 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 15:53:49.445028 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440251 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 15:53:49.445028 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440254 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 15:53:49.445028 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440256 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 15:53:49.445028 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440259 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 15:53:49.445028 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440263 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 15:53:49.445028 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440266 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 15:53:49.445028 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440269 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 15:53:49.445028 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440272 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 15:53:49.445028 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440275 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 27 15:53:49.445028 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440278 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 15:53:49.445028 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440281 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 15:53:49.445028 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:49.440283 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 15:53:49.445499 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.440288 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 27 15:53:49.445499 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.440424 2561 server.go:962] "Client rotation is on, will bootstrap in background" Jul 27 15:53:49.445499 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.442368 2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 27 15:53:49.445499 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.443460 2561 server.go:1019] "Starting client certificate rotation" Jul 27 15:53:49.445499 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.443559 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 27 15:53:49.445499 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.443593 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 27 15:53:49.445934 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.445921 2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 27 15:53:49.447117 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.447097 2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 27 15:53:49.456708 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.456681 2561 log.go:25] "Validated CRI v1 runtime API" Jul 27 15:53:49.460851 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.460833 2561 log.go:25] "Validated CRI v1 image API" Jul 27 15:53:49.462012 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.461987 2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 27 15:53:49.464382 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.464350 2561 fs.go:135] Filesystem UUIDs: map[123a5ea5-f76d-4ec0-be2f-d27108c32157:/dev/nvme0n1p4 3e483bd8-c319-4c16-85d2-e78563e2ad86:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 27 15:53:49.464382 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.464381 2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 27 15:53:49.469394 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.469274 2561 manager.go:216] Machine: {Timestamp:2026-07-27 15:53:49.468747723 +0000 UTC m=+0.262473993 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3105621 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26cc58fa1260a1dddd2fe9adab94d3 SystemUUID:ec26cc58-fa12-60a1-dddd-2fe9adab94d3 BootID:0345e5e5-6805-4fea-9c27-19d689668877 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:bb:4f:75:d2:59 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:bb:4f:75:d2:59 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6a:dd:c7:50:07:6b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 27 15:53:49.469394 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.469382 2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 27 15:53:49.469524 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.469497 2561 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 27 15:53:49.472009 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.471979 2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 27 15:53:49.472143 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.472011 2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-4.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 27 15:53:49.472665 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.472656 2561 topology_manager.go:138] "Creating topology manager with none policy" Jul 27 15:53:49.472696 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.472668 2561 container_manager_linux.go:309] "Creating device plugin manager" Jul 27 15:53:49.472696 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.472676 2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 27 15:53:49.473273 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.473263 2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 27 15:53:49.474585 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.474572 2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 27 15:53:49.475827 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.475810 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 27 15:53:49.478471 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.478458 2561 state_mem.go:36] "Initialized new in-memory state store" Jul 27 15:53:49.478603 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.478593 2561 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 27 15:53:49.478641 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.478627 2561 kubelet.go:486] "Attempting to sync node with API server" Jul 27 15:53:49.478669 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.478642 2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 27 15:53:49.478669 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.478663 2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 27 15:53:49.478721 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.478679 2561 kubelet.go:398] "Adding apiserver pod source" Jul 27 15:53:49.478721 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.478691 2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 27 15:53:49.479062 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.479049 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 27 15:53:49.479111 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.479068 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 27 15:53:49.480904 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.480884 2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 27 15:53:49.482313 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.482300 2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 27 15:53:49.482362 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.482330 2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 27 15:53:49.482951 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.482941 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 27 15:53:49.482992 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.482957 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 27 15:53:49.482992 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.482964 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 27 15:53:49.482992 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.482970 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 27 15:53:49.482992 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.482979 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 27 15:53:49.482992 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.482986 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 27 15:53:49.482992 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.482994 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 27 15:53:49.483147 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.483000 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 27 15:53:49.483147 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.483007 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 27 15:53:49.483147 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.483013 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 27 15:53:49.483147 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.483022 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 27 15:53:49.483147 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.483028 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 27 15:53:49.483658 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.483649 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 27 15:53:49.483658 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.483658 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 27 15:53:49.486931 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.486916 2561 server.go:1268] "Started kubelet" Jul 27 15:53:49.487019 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.486974 2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 27 15:53:49.487776 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.487724 2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 27 15:53:49.487888 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.487816 2561 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 27 15:53:49.487853 ip-10-0-142-4 systemd[1]: Started Kubernetes Kubelet. Jul 27 15:53:49.489399 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.489381 2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 27 15:53:49.489677 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.489652 2561 server.go:310] "Adding debug handlers to kubelet server" Jul 27 15:53:49.491431 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:49.491406 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-4.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 27 15:53:49.491525 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:49.491468 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 27 15:53:49.491571 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.491546 2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-4.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 27 15:53:49.493645 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:49.493615 2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 27 15:53:49.496757 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.496731 2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 27 15:53:49.496757 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.496753 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 27 15:53:49.496944 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:49.496909 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-4.ec2.internal\" not found" Jul 27 15:53:49.497396 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.497379 2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 27 15:53:49.497396 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.497390 2561 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 27 15:53:49.497526 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.497407 2561 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 27 15:53:49.497526 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.497515 2561 reconstruct.go:97] "Volume reconstruction finished" Jul 27 15:53:49.497526 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.497525 2561 reconciler.go:29] "Reconciler: start to sync state" Jul 27 15:53:49.497630 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.497615 2561 factory.go:55] Registering systemd factory Jul 27 15:53:49.497665 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.497658 2561 factory.go:223] Registration of the systemd container factory successfully Jul 27 15:53:49.497920 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.497901 2561 factory.go:153] Registering CRI-O factory Jul 27 15:53:49.497920 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.497922 2561 factory.go:223] Registration of the crio container factory successfully Jul 27 15:53:49.498083 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.497974 2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 27 15:53:49.498083 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.497995 2561 factory.go:103] Registering Raw factory Jul 27 15:53:49.498083 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.498009 2561 manager.go:1196] Started watching for new ooms in manager Jul 27 15:53:49.499042 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.499009 2561 manager.go:349] Starting recovery of all containers Jul 27 15:53:49.504901 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:49.504873 2561 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-4.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 27 15:53:49.504985 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:49.504946 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 27 15:53:49.506709 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:49.505031 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-4.ec2.internal.18c63080341789df default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-4.ec2.internal,UID:ip-10-0-142-4.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-4.ec2.internal,},FirstTimestamp:2026-07-27 15:53:49.486885343 +0000 UTC m=+0.280611613,LastTimestamp:2026-07-27 15:53:49.486885343 +0000 UTC m=+0.280611613,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-4.ec2.internal,}" Jul 27 15:53:49.510780 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.510754 2561 manager.go:354] Recovery completed Jul 27 15:53:49.512299 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:49.512274 2561 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 27 15:53:49.515437 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.515423 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 15:53:49.517372 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.517340 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-4.ec2.internal" event="NodeHasSufficientMemory" Jul 27 15:53:49.517435 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.517389 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-4.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 15:53:49.517435 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.517400 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-4.ec2.internal" event="NodeHasSufficientPID" Jul 27 15:53:49.517968 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.517952 2561 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 27 15:53:49.517968 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.517966 2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 27 15:53:49.518060 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.517984 2561 state_mem.go:36] "Initialized new in-memory state store" Jul 27 15:53:49.518060 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.517965 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 15:53:49.518760 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.518742 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-4.ec2.internal" event="NodeHasSufficientMemory" Jul 27 15:53:49.518834 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.518771 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-4.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 15:53:49.518834 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.518780 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-4.ec2.internal" event="NodeHasSufficientPID" Jul 27 15:53:49.519650 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:49.519582 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-4.ec2.internal.18c6308035e8c118 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-4.ec2.internal,UID:ip-10-0-142-4.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-4.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-4.ec2.internal,},FirstTimestamp:2026-07-27 15:53:49.51737372 +0000 UTC m=+0.311099989,LastTimestamp:2026-07-27 15:53:49.51737372 +0000 UTC m=+0.311099989,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-4.ec2.internal,}" Jul 27 15:53:49.520289 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.520275 2561 policy_none.go:49] "None policy: Start" Jul 27 15:53:49.520329 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.520295 2561 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 27 15:53:49.520329 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.520306 2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 27 15:53:49.522357 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.522345 2561 policy_none.go:47] "Start" Jul 27 15:53:49.527309 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.527288 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fp2ch" Jul 27 15:53:49.530030 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:49.529950 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-4.ec2.internal.18c6308035e9119b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-4.ec2.internal,UID:ip-10-0-142-4.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-4.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-4.ec2.internal,},FirstTimestamp:2026-07-27 15:53:49.517394331 +0000 UTC m=+0.311120601,LastTimestamp:2026-07-27 15:53:49.517394331 +0000 UTC m=+0.311120601,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-4.ec2.internal,}" Jul 27 15:53:49.535504 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.535482 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fp2ch" Jul 27 15:53:49.542108 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:49.542013 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-4.ec2.internal.18c6308035e939af default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-4.ec2.internal,UID:ip-10-0-142-4.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-142-4.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-142-4.ec2.internal,},FirstTimestamp:2026-07-27 15:53:49.517404591 +0000 UTC m=+0.311130861,LastTimestamp:2026-07-27 15:53:49.517404591 +0000 UTC m=+0.311130861,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-4.ec2.internal,}" Jul 27 15:53:49.554577 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.554415 2561 manager.go:337] "Starting Device Plugin manager" Jul 27 15:53:49.554670 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:49.554597 2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 27 15:53:49.554670 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.554611 2561 server.go:87] "Starting device plugin registration server" Jul 27 15:53:49.554891 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.554878 2561 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 27 15:53:49.554950 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.554893 2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 27 15:53:49.555018 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.555003 2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 27 15:53:49.555097 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.555086 2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 27 15:53:49.555097 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.555096 2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 27 15:53:49.555745 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:49.555724 2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 27 15:53:49.555822 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:49.555789 2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-4.ec2.internal\" not found" Jul 27 15:53:49.628769 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.628710 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 27 15:53:49.630988 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.629939 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 27 15:53:49.630988 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.629979 2561 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 27 15:53:49.630988 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.630005 2561 kubelet.go:2448] "Starting kubelet main sync loop" Jul 27 15:53:49.630988 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:49.630044 2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 27 15:53:49.633121 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.633094 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 15:53:49.655712 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.655681 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 15:53:49.656751 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.656728 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-4.ec2.internal" event="NodeHasSufficientMemory" Jul 27 15:53:49.656856 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.656765 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-4.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 15:53:49.656856 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.656775 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-4.ec2.internal" event="NodeHasSufficientPID" Jul 27 15:53:49.656856 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.656816 2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-4.ec2.internal" Jul 27 15:53:49.665846 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.665828 2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-4.ec2.internal" Jul 27 15:53:49.665965 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:49.665855 2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-4.ec2.internal\": node \"ip-10-0-142-4.ec2.internal\" not found" Jul 27 15:53:49.695571 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:49.695470 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-4.ec2.internal\" not found" Jul 27 15:53:49.730815 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.730221 2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-4.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-4.ec2.internal"] Jul 27 15:53:49.730974 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.730866 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 15:53:49.732039 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.732022 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-4.ec2.internal" event="NodeHasSufficientMemory" Jul 27 15:53:49.732125 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.732056 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-4.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 15:53:49.732125 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.732068 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-4.ec2.internal" event="NodeHasSufficientPID" Jul 27 15:53:49.734314 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.734301 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 15:53:49.734443 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.734428 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-4.ec2.internal" Jul 27 15:53:49.734489 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.734465 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 15:53:49.735266 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.735249 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-4.ec2.internal" event="NodeHasSufficientMemory" Jul 27 15:53:49.735266 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.735271 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-4.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 15:53:49.735396 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.735285 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-4.ec2.internal" event="NodeHasSufficientPID" Jul 27 15:53:49.735441 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.735282 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-4.ec2.internal" event="NodeHasSufficientMemory" Jul 27 15:53:49.735441 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.735427 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-4.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 15:53:49.735441 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.735439 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-4.ec2.internal" event="NodeHasSufficientPID" Jul 27 15:53:49.737600 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.737585 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-4.ec2.internal" Jul 27 15:53:49.737674 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.737612 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 15:53:49.738390 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.738374 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-4.ec2.internal" event="NodeHasSufficientMemory" Jul 27 15:53:49.738503 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.738404 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-4.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 15:53:49.738503 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.738419 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-4.ec2.internal" event="NodeHasSufficientPID" Jul 27 15:53:49.753376 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:49.753353 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-4.ec2.internal\" not found" node="ip-10-0-142-4.ec2.internal" Jul 27 15:53:49.756779 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:49.756762 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-4.ec2.internal\" not found" node="ip-10-0-142-4.ec2.internal" Jul 27 15:53:49.795894 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:49.795861 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-4.ec2.internal\" not found" Jul 27 15:53:49.799413 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.799394 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/94064bde37d1f180cd8431f305ec203f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-4.ec2.internal\" (UID: \"94064bde37d1f180cd8431f305ec203f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-4.ec2.internal" Jul 27 15:53:49.799473 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.799422 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/94064bde37d1f180cd8431f305ec203f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-4.ec2.internal\" (UID: \"94064bde37d1f180cd8431f305ec203f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-4.ec2.internal" Jul 27 15:53:49.799473 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.799441 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fc7a2b8b8acfc7d700d26229752a314e-config\") pod \"kube-apiserver-proxy-ip-10-0-142-4.ec2.internal\" (UID: \"fc7a2b8b8acfc7d700d26229752a314e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-4.ec2.internal" Jul 27 15:53:49.899697 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:49.899652 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-4.ec2.internal\" not found" Jul 27 15:53:49.899697 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.899652 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/94064bde37d1f180cd8431f305ec203f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-4.ec2.internal\" (UID: \"94064bde37d1f180cd8431f305ec203f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-4.ec2.internal" Jul 27 15:53:49.899894 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.899714 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/94064bde37d1f180cd8431f305ec203f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-4.ec2.internal\" (UID: \"94064bde37d1f180cd8431f305ec203f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-4.ec2.internal" Jul 27 15:53:49.899894 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.899757 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/94064bde37d1f180cd8431f305ec203f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-4.ec2.internal\" (UID: \"94064bde37d1f180cd8431f305ec203f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-4.ec2.internal" Jul 27 15:53:49.899894 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.899722 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/94064bde37d1f180cd8431f305ec203f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-4.ec2.internal\" (UID: \"94064bde37d1f180cd8431f305ec203f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-4.ec2.internal" Jul 27 15:53:49.899894 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.899793 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fc7a2b8b8acfc7d700d26229752a314e-config\") pod \"kube-apiserver-proxy-ip-10-0-142-4.ec2.internal\" (UID: \"fc7a2b8b8acfc7d700d26229752a314e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-4.ec2.internal" Jul 27 15:53:49.899894 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:49.899841 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fc7a2b8b8acfc7d700d26229752a314e-config\") pod \"kube-apiserver-proxy-ip-10-0-142-4.ec2.internal\" (UID: \"fc7a2b8b8acfc7d700d26229752a314e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-4.ec2.internal" Jul 27 15:53:50.000478 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:50.000393 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-4.ec2.internal\" not found" Jul 27 15:53:50.058850 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:50.058795 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-4.ec2.internal" Jul 27 15:53:50.059977 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:50.059962 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-4.ec2.internal" Jul 27 15:53:50.100645 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:50.100608 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-4.ec2.internal\" not found" Jul 27 15:53:50.202767 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:50.202720 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-4.ec2.internal\" not found" Jul 27 15:53:50.304888 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:50.304790 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-4.ec2.internal\" not found" Jul 27 15:53:50.404951 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:50.404917 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-4.ec2.internal\" not found" Jul 27 15:53:50.445170 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:50.445125 2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 27 15:53:50.445612 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:50.445318 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 27 15:53:50.505768 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:50.505736 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-4.ec2.internal\" not found" Jul 27 15:53:50.524386 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:50.524363 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 15:53:50.543389 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:50.543343 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-26 15:48:50 +0000 UTC" deadline="2028-02-25 15:40:00.880475243 +0000 UTC" Jul 27 15:53:50.543389 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:50.543388 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13871h46m10.337091447s" Jul 27 15:53:50.606736 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:50.606669 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-4.ec2.internal\" not found" Jul 27 15:53:50.697389 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:50.697347 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 15:53:50.698862 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:50.698843 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-4.ec2.internal" event="NodeHasSufficientMemory" Jul 27 15:53:50.698986 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:50.698877 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-4.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 15:53:50.698986 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:50.698888 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-4.ec2.internal" event="NodeHasSufficientPID" Jul 27 15:53:50.707146 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:50.707128 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-4.ec2.internal\" not found" Jul 27 15:53:50.807920 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:50.807888 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-4.ec2.internal\" not found" Jul 27 15:53:50.908647 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:50.908540 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-4.ec2.internal\" not found" Jul 27 15:53:51.009487 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:51.009449 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-4.ec2.internal\" not found" Jul 27 15:53:51.012806 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.012786 2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 15:53:51.079501 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.079475 2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 15:53:51.098294 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.098266 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-4.ec2.internal" Jul 27 15:53:51.112094 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.112065 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 27 15:53:51.113076 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.113062 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-4.ec2.internal" Jul 27 15:53:51.120021 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.120005 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 27 15:53:51.256292 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.256210 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 15:53:51.481328 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.481287 2561 apiserver.go:52] "Watching apiserver" Jul 27 15:53:51.488107 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.488080 2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 27 15:53:51.488511 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.488487 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-v2tkp","openshift-dns/node-resolver-zf9cg","openshift-image-registry/node-ca-62j4b","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-4.ec2.internal","openshift-multus/multus-7nsnh","openshift-multus/multus-additional-cni-plugins-tzdrq","openshift-network-operator/iptables-alerter-29p88","openshift-ovn-kubernetes/ovnkube-node-8mnsv","kube-system/konnectivity-agent-4l8tg","kube-system/kube-apiserver-proxy-ip-10-0-142-4.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxd6w","openshift-cluster-node-tuning-operator/tuned-t7xdc","openshift-multus/network-metrics-daemon-vpk45","openshift-network-diagnostics/network-check-target-6khtd"] Jul 27 15:53:51.490969 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.490949 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vpk45" Jul 27 15:53:51.491073 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:51.491047 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vpk45" podUID="2875ea72-06f8-4c75-b39b-2524b82f6875" Jul 27 15:53:51.493282 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.493261 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zf9cg" Jul 27 15:53:51.495455 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.495429 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 27 15:53:51.495455 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.495446 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 27 15:53:51.495645 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.495600 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-62j4b" Jul 27 15:53:51.495645 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.495608 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-s2mb2\"" Jul 27 15:53:51.497087 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.497068 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 27 15:53:51.497413 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.497392 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-xrjmb\"" Jul 27 15:53:51.497413 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.497404 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 27 15:53:51.497546 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.497475 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 27 15:53:51.497868 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.497832 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 27 15:53:51.498552 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.498147 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2tkp" Jul 27 15:53:51.498552 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:51.498232 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2tkp" podUID="db554c84-03a7-4127-8c5b-c7c18897237d" Jul 27 15:53:51.500755 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.500731 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7nsnh" Jul 27 15:53:51.502467 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.502448 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 27 15:53:51.502572 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.502556 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 27 15:53:51.502645 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.502625 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 27 15:53:51.502785 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.502770 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-z2dms\"" Jul 27 15:53:51.502860 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.502842 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 27 15:53:51.503146 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.503129 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tzdrq" Jul 27 15:53:51.504898 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.504860 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 27 15:53:51.504989 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.504863 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kf9qt\"" Jul 27 15:53:51.505045 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.505024 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 27 15:53:51.505953 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.505931 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-29p88" Jul 27 15:53:51.507658 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.507637 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 27 15:53:51.507755 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.507692 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 27 15:53:51.507755 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.507735 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 27 15:53:51.507899 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.507760 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7skgl\"" Jul 27 15:53:51.508423 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.508404 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.509904 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.509884 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 27 15:53:51.510302 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.510265 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 27 15:53:51.510375 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.510268 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 27 15:53:51.510418 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.510406 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 27 15:53:51.510510 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.510488 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 27 15:53:51.510841 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.510804 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-k5ppq\"" Jul 27 15:53:51.510942 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.510854 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 27 15:53:51.510942 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.510865 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4l8tg" Jul 27 15:53:51.512752 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.512734 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d8db91e-5711-4fa5-af72-baa451e66451-tmp-dir\") pod \"node-resolver-zf9cg\" (UID: \"8d8db91e-5711-4fa5-af72-baa451e66451\") " pod="openshift-dns/node-resolver-zf9cg" Jul 27 15:53:51.512825 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.512758 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aadbe564-2de9-44b9-b409-b190bc6f4a26-host\") pod \"node-ca-62j4b\" (UID: \"aadbe564-2de9-44b9-b409-b190bc6f4a26\") " pod="openshift-image-registry/node-ca-62j4b" Jul 27 15:53:51.512825 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.512796 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/aadbe564-2de9-44b9-b409-b190bc6f4a26-serviceca\") pod \"node-ca-62j4b\" (UID: \"aadbe564-2de9-44b9-b409-b190bc6f4a26\") " pod="openshift-image-registry/node-ca-62j4b" Jul 27 15:53:51.512825 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.512818 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2875ea72-06f8-4c75-b39b-2524b82f6875-metrics-certs\") pod \"network-metrics-daemon-vpk45\" (UID: \"2875ea72-06f8-4c75-b39b-2524b82f6875\") " pod="openshift-multus/network-metrics-daemon-vpk45" Jul 27 15:53:51.512962 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.512863 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpgm9\" (UniqueName: \"kubernetes.io/projected/8d8db91e-5711-4fa5-af72-baa451e66451-kube-api-access-kpgm9\") pod \"node-resolver-zf9cg\" (UID: \"8d8db91e-5711-4fa5-af72-baa451e66451\") " pod="openshift-dns/node-resolver-zf9cg" Jul 27 15:53:51.512962 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.512901 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vf8z9\" (UniqueName: \"kubernetes.io/projected/aadbe564-2de9-44b9-b409-b190bc6f4a26-kube-api-access-vf8z9\") pod \"node-ca-62j4b\" (UID: \"aadbe564-2de9-44b9-b409-b190bc6f4a26\") " pod="openshift-image-registry/node-ca-62j4b" Jul 27 15:53:51.512962 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.512956 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/db554c84-03a7-4127-8c5b-c7c18897237d-kubelet-config\") pod \"global-pull-secret-syncer-v2tkp\" (UID: \"db554c84-03a7-4127-8c5b-c7c18897237d\") " pod="kube-system/global-pull-secret-syncer-v2tkp" Jul 27 15:53:51.513061 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.512987 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/db554c84-03a7-4127-8c5b-c7c18897237d-dbus\") pod \"global-pull-secret-syncer-v2tkp\" (UID: \"db554c84-03a7-4127-8c5b-c7c18897237d\") " pod="kube-system/global-pull-secret-syncer-v2tkp" Jul 27 15:53:51.513061 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.513026 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db554c84-03a7-4127-8c5b-c7c18897237d-original-pull-secret\") pod \"global-pull-secret-syncer-v2tkp\" (UID: \"db554c84-03a7-4127-8c5b-c7c18897237d\") " pod="kube-system/global-pull-secret-syncer-v2tkp" Jul 27 15:53:51.513127 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.513065 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 27 15:53:51.513127 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.513088 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnwcc\" (UniqueName: \"kubernetes.io/projected/2875ea72-06f8-4c75-b39b-2524b82f6875-kube-api-access-xnwcc\") pod \"network-metrics-daemon-vpk45\" (UID: \"2875ea72-06f8-4c75-b39b-2524b82f6875\") " pod="openshift-multus/network-metrics-daemon-vpk45" Jul 27 15:53:51.513127 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.513097 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 27 15:53:51.513127 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.513115 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8d8db91e-5711-4fa5-af72-baa451e66451-hosts-file\") pod \"node-resolver-zf9cg\" (UID: \"8d8db91e-5711-4fa5-af72-baa451e66451\") " pod="openshift-dns/node-resolver-zf9cg" Jul 27 15:53:51.513405 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.513390 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6khtd" Jul 27 15:53:51.513466 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:51.513448 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6khtd" podUID="26984101-b8ab-4b8c-9272-2cc91f0e2ee9" Jul 27 15:53:51.513761 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.513743 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 27 15:53:51.513896 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.513881 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-m6nrz\"" Jul 27 15:53:51.515760 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.515743 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxd6w" Jul 27 15:53:51.517400 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.517377 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 27 15:53:51.517496 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.517455 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 27 15:53:51.517696 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.517665 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-7k255\"" Jul 27 15:53:51.517839 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.517823 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 27 15:53:51.518468 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.518445 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-t7xdc" Jul 27 15:53:51.520322 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.520233 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 27 15:53:51.520322 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.520269 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 27 15:53:51.520322 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.520313 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8w254\"" Jul 27 15:53:51.538616 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:51.538583 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94064bde37d1f180cd8431f305ec203f.slice/crio-de725c82b69f454f4380b2b65042f2e7ad5fe8012a34947c39627dd342871a6d WatchSource:0}: Error finding container de725c82b69f454f4380b2b65042f2e7ad5fe8012a34947c39627dd342871a6d: Status 404 returned error can't find the container with id de725c82b69f454f4380b2b65042f2e7ad5fe8012a34947c39627dd342871a6d Jul 27 15:53:51.542029 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.542006 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-sxw5x" Jul 27 15:53:51.543335 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.543305 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 27 15:53:51.551421 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.551401 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-sxw5x" Jul 27 15:53:51.598936 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.598912 2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 27 15:53:51.614191 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.614159 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dd45f717-ad83-4aad-ba24-2b77778ff926-host-run-multus-certs\") pod \"multus-7nsnh\" (UID: \"dd45f717-ad83-4aad-ba24-2b77778ff926\") " pod="openshift-multus/multus-7nsnh" Jul 27 15:53:51.614308 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.614197 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4110ede3-5c49-41c8-90d7-091cbc5def4a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.614308 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.614218 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff-host\") pod \"tuned-t7xdc\" (UID: \"ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff\") " pod="openshift-cluster-node-tuning-operator/tuned-t7xdc" Jul 27 15:53:51.614308 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.614246 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8d8db91e-5711-4fa5-af72-baa451e66451-hosts-file\") pod \"node-resolver-zf9cg\" (UID: \"8d8db91e-5711-4fa5-af72-baa451e66451\") " pod="openshift-dns/node-resolver-zf9cg" Jul 27 15:53:51.614308 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.614289 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlds4\" (UniqueName: \"kubernetes.io/projected/b43e7b7b-4cf8-4ee9-a131-23c2dd05154e-kube-api-access-hlds4\") pod \"aws-ebs-csi-driver-node-xxd6w\" (UID: \"b43e7b7b-4cf8-4ee9-a131-23c2dd05154e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxd6w" Jul 27 15:53:51.614484 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.614356 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff-etc-sysctl-conf\") pod \"tuned-t7xdc\" (UID: \"ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff\") " pod="openshift-cluster-node-tuning-operator/tuned-t7xdc" Jul 27 15:53:51.614484 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.614365 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8d8db91e-5711-4fa5-af72-baa451e66451-hosts-file\") pod \"node-resolver-zf9cg\" (UID: \"8d8db91e-5711-4fa5-af72-baa451e66451\") " pod="openshift-dns/node-resolver-zf9cg" Jul 27 15:53:51.614484 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.614384 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g84h8\" (UniqueName: \"kubernetes.io/projected/ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff-kube-api-access-g84h8\") pod \"tuned-t7xdc\" (UID: \"ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff\") " pod="openshift-cluster-node-tuning-operator/tuned-t7xdc" Jul 27 15:53:51.614484 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.614412 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4110ede3-5c49-41c8-90d7-091cbc5def4a-run-systemd\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.614484 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.614461 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4110ede3-5c49-41c8-90d7-091cbc5def4a-ovnkube-config\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.614807 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.614505 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aadbe564-2de9-44b9-b409-b190bc6f4a26-host\") pod \"node-ca-62j4b\" (UID: \"aadbe564-2de9-44b9-b409-b190bc6f4a26\") " pod="openshift-image-registry/node-ca-62j4b" Jul 27 15:53:51.614807 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.614533 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/db554c84-03a7-4127-8c5b-c7c18897237d-dbus\") pod \"global-pull-secret-syncer-v2tkp\" (UID: \"db554c84-03a7-4127-8c5b-c7c18897237d\") " pod="kube-system/global-pull-secret-syncer-v2tkp" Jul 27 15:53:51.614807 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.614562 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a28e8365-5281-405d-aa55-bc4ff9a8b671-cnibin\") pod \"multus-additional-cni-plugins-tzdrq\" (UID: \"a28e8365-5281-405d-aa55-bc4ff9a8b671\") " pod="openshift-multus/multus-additional-cni-plugins-tzdrq" Jul 27 15:53:51.614807 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.614588 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4110ede3-5c49-41c8-90d7-091cbc5def4a-host-kubelet\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.614807 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.614609 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aadbe564-2de9-44b9-b409-b190bc6f4a26-host\") pod \"node-ca-62j4b\" (UID: \"aadbe564-2de9-44b9-b409-b190bc6f4a26\") " pod="openshift-image-registry/node-ca-62j4b" Jul 27 15:53:51.614807 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.614632 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4110ede3-5c49-41c8-90d7-091cbc5def4a-etc-openvswitch\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.614807 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.614658 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4110ede3-5c49-41c8-90d7-091cbc5def4a-host-cni-netd\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.614807 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.614684 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff-etc-kubernetes\") pod \"tuned-t7xdc\" (UID: \"ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff\") " pod="openshift-cluster-node-tuning-operator/tuned-t7xdc" Jul 27 15:53:51.614807 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.614710 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff-etc-sysctl-d\") pod \"tuned-t7xdc\" (UID: \"ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff\") " pod="openshift-cluster-node-tuning-operator/tuned-t7xdc" Jul 27 15:53:51.614807 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.614736 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a28e8365-5281-405d-aa55-bc4ff9a8b671-system-cni-dir\") pod \"multus-additional-cni-plugins-tzdrq\" (UID: \"a28e8365-5281-405d-aa55-bc4ff9a8b671\") " pod="openshift-multus/multus-additional-cni-plugins-tzdrq" Jul 27 15:53:51.614807 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.614756 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/db554c84-03a7-4127-8c5b-c7c18897237d-dbus\") pod \"global-pull-secret-syncer-v2tkp\" (UID: \"db554c84-03a7-4127-8c5b-c7c18897237d\") " pod="kube-system/global-pull-secret-syncer-v2tkp" Jul 27 15:53:51.614807 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.614763 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4110ede3-5c49-41c8-90d7-091cbc5def4a-host-run-ovn-kubernetes\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.614807 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.614804 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4110ede3-5c49-41c8-90d7-091cbc5def4a-ovnkube-script-lib\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.615247 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.614850 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b43e7b7b-4cf8-4ee9-a131-23c2dd05154e-device-dir\") pod \"aws-ebs-csi-driver-node-xxd6w\" (UID: \"b43e7b7b-4cf8-4ee9-a131-23c2dd05154e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxd6w" Jul 27 15:53:51.615247 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.614866 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b43e7b7b-4cf8-4ee9-a131-23c2dd05154e-sys-fs\") pod \"aws-ebs-csi-driver-node-xxd6w\" (UID: \"b43e7b7b-4cf8-4ee9-a131-23c2dd05154e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxd6w" Jul 27 15:53:51.615247 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.614884 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff-etc-sysconfig\") pod \"tuned-t7xdc\" (UID: \"ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff\") " pod="openshift-cluster-node-tuning-operator/tuned-t7xdc" Jul 27 15:53:51.615247 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.614898 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff-run\") pod \"tuned-t7xdc\" (UID: \"ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff\") " pod="openshift-cluster-node-tuning-operator/tuned-t7xdc" Jul 27 15:53:51.615247 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.614912 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dd45f717-ad83-4aad-ba24-2b77778ff926-os-release\") pod \"multus-7nsnh\" (UID: \"dd45f717-ad83-4aad-ba24-2b77778ff926\") " pod="openshift-multus/multus-7nsnh" Jul 27 15:53:51.615247 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.614929 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c363121b-53af-4035-86d4-b535c823d3c4-iptables-alerter-script\") pod \"iptables-alerter-29p88\" (UID: \"c363121b-53af-4035-86d4-b535c823d3c4\") " pod="openshift-network-operator/iptables-alerter-29p88" Jul 27 15:53:51.615247 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.614956 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4110ede3-5c49-41c8-90d7-091cbc5def4a-host-cni-bin\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.615247 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.614982 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dd45f717-ad83-4aad-ba24-2b77778ff926-system-cni-dir\") pod \"multus-7nsnh\" (UID: \"dd45f717-ad83-4aad-ba24-2b77778ff926\") " pod="openshift-multus/multus-7nsnh" Jul 27 15:53:51.615247 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.615000 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcc98\" (UniqueName: \"kubernetes.io/projected/dd45f717-ad83-4aad-ba24-2b77778ff926-kube-api-access-qcc98\") pod \"multus-7nsnh\" (UID: \"dd45f717-ad83-4aad-ba24-2b77778ff926\") " pod="openshift-multus/multus-7nsnh" Jul 27 15:53:51.615247 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.615025 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsdnn\" (UniqueName: \"kubernetes.io/projected/26984101-b8ab-4b8c-9272-2cc91f0e2ee9-kube-api-access-rsdnn\") pod \"network-check-target-6khtd\" (UID: \"26984101-b8ab-4b8c-9272-2cc91f0e2ee9\") " pod="openshift-network-diagnostics/network-check-target-6khtd" Jul 27 15:53:51.615247 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.615051 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpgm9\" (UniqueName: \"kubernetes.io/projected/8d8db91e-5711-4fa5-af72-baa451e66451-kube-api-access-kpgm9\") pod \"node-resolver-zf9cg\" (UID: \"8d8db91e-5711-4fa5-af72-baa451e66451\") " pod="openshift-dns/node-resolver-zf9cg" Jul 27 15:53:51.615247 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.615106 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a28e8365-5281-405d-aa55-bc4ff9a8b671-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tzdrq\" (UID: \"a28e8365-5281-405d-aa55-bc4ff9a8b671\") " pod="openshift-multus/multus-additional-cni-plugins-tzdrq" Jul 27 15:53:51.615247 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.615127 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4110ede3-5c49-41c8-90d7-091cbc5def4a-host-slash\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.615247 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.615146 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4110ede3-5c49-41c8-90d7-091cbc5def4a-run-openvswitch\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.615247 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.615166 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxzhr\" (UniqueName: \"kubernetes.io/projected/4110ede3-5c49-41c8-90d7-091cbc5def4a-kube-api-access-mxzhr\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.615247 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.615192 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dd45f717-ad83-4aad-ba24-2b77778ff926-multus-daemon-config\") pod \"multus-7nsnh\" (UID: \"dd45f717-ad83-4aad-ba24-2b77778ff926\") " pod="openshift-multus/multus-7nsnh" Jul 27 15:53:51.616103 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.615209 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b43e7b7b-4cf8-4ee9-a131-23c2dd05154e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xxd6w\" (UID: \"b43e7b7b-4cf8-4ee9-a131-23c2dd05154e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxd6w" Jul 27 15:53:51.616103 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.615228 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a28e8365-5281-405d-aa55-bc4ff9a8b671-cni-binary-copy\") pod \"multus-additional-cni-plugins-tzdrq\" (UID: \"a28e8365-5281-405d-aa55-bc4ff9a8b671\") " pod="openshift-multus/multus-additional-cni-plugins-tzdrq" Jul 27 15:53:51.616103 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.615246 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff-etc-tuned\") pod \"tuned-t7xdc\" (UID: \"ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff\") " pod="openshift-cluster-node-tuning-operator/tuned-t7xdc" Jul 27 15:53:51.616103 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.615273 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2875ea72-06f8-4c75-b39b-2524b82f6875-metrics-certs\") pod \"network-metrics-daemon-vpk45\" (UID: \"2875ea72-06f8-4c75-b39b-2524b82f6875\") " pod="openshift-multus/network-metrics-daemon-vpk45" Jul 27 15:53:51.616103 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.615296 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a28e8365-5281-405d-aa55-bc4ff9a8b671-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tzdrq\" (UID: \"a28e8365-5281-405d-aa55-bc4ff9a8b671\") " pod="openshift-multus/multus-additional-cni-plugins-tzdrq" Jul 27 15:53:51.616103 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.615316 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dd45f717-ad83-4aad-ba24-2b77778ff926-cnibin\") pod \"multus-7nsnh\" (UID: \"dd45f717-ad83-4aad-ba24-2b77778ff926\") " pod="openshift-multus/multus-7nsnh" Jul 27 15:53:51.616103 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.615333 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dd45f717-ad83-4aad-ba24-2b77778ff926-multus-socket-dir-parent\") pod \"multus-7nsnh\" (UID: \"dd45f717-ad83-4aad-ba24-2b77778ff926\") " pod="openshift-multus/multus-7nsnh" Jul 27 15:53:51.616103 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.615428 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd45f717-ad83-4aad-ba24-2b77778ff926-etc-kubernetes\") pod \"multus-7nsnh\" (UID: \"dd45f717-ad83-4aad-ba24-2b77778ff926\") " pod="openshift-multus/multus-7nsnh" Jul 27 15:53:51.616103 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:51.615444 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 15:53:51.616103 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.615446 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b43e7b7b-4cf8-4ee9-a131-23c2dd05154e-registration-dir\") pod \"aws-ebs-csi-driver-node-xxd6w\" (UID: \"b43e7b7b-4cf8-4ee9-a131-23c2dd05154e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxd6w" Jul 27 15:53:51.616103 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:51.615528 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2875ea72-06f8-4c75-b39b-2524b82f6875-metrics-certs podName:2875ea72-06f8-4c75-b39b-2524b82f6875 nodeName:}" failed. No retries permitted until 2026-07-27 15:53:52.115502586 +0000 UTC m=+2.909228870 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2875ea72-06f8-4c75-b39b-2524b82f6875-metrics-certs") pod "network-metrics-daemon-vpk45" (UID: "2875ea72-06f8-4c75-b39b-2524b82f6875") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 15:53:51.616103 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.615559 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff-sys\") pod \"tuned-t7xdc\" (UID: \"ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff\") " pod="openshift-cluster-node-tuning-operator/tuned-t7xdc" Jul 27 15:53:51.616103 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.615591 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnwcc\" (UniqueName: \"kubernetes.io/projected/2875ea72-06f8-4c75-b39b-2524b82f6875-kube-api-access-xnwcc\") pod \"network-metrics-daemon-vpk45\" (UID: \"2875ea72-06f8-4c75-b39b-2524b82f6875\") " pod="openshift-multus/network-metrics-daemon-vpk45" Jul 27 15:53:51.616103 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.615638 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/db554c84-03a7-4127-8c5b-c7c18897237d-kubelet-config\") pod \"global-pull-secret-syncer-v2tkp\" (UID: \"db554c84-03a7-4127-8c5b-c7c18897237d\") " pod="kube-system/global-pull-secret-syncer-v2tkp" Jul 27 15:53:51.616103 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.615667 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7299eae8-57e9-40fa-a73d-6ca4856375de-agent-certs\") pod \"konnectivity-agent-4l8tg\" (UID: \"7299eae8-57e9-40fa-a73d-6ca4856375de\") " pod="kube-system/konnectivity-agent-4l8tg" Jul 27 15:53:51.616103 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.615695 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b43e7b7b-4cf8-4ee9-a131-23c2dd05154e-socket-dir\") pod \"aws-ebs-csi-driver-node-xxd6w\" (UID: \"b43e7b7b-4cf8-4ee9-a131-23c2dd05154e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxd6w" Jul 27 15:53:51.616826 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.615723 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a28e8365-5281-405d-aa55-bc4ff9a8b671-os-release\") pod \"multus-additional-cni-plugins-tzdrq\" (UID: \"a28e8365-5281-405d-aa55-bc4ff9a8b671\") " pod="openshift-multus/multus-additional-cni-plugins-tzdrq" Jul 27 15:53:51.616826 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.615733 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/db554c84-03a7-4127-8c5b-c7c18897237d-kubelet-config\") pod \"global-pull-secret-syncer-v2tkp\" (UID: \"db554c84-03a7-4127-8c5b-c7c18897237d\") " pod="kube-system/global-pull-secret-syncer-v2tkp" Jul 27 15:53:51.616826 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.615767 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4110ede3-5c49-41c8-90d7-091cbc5def4a-var-lib-openvswitch\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.616826 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.615793 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4110ede3-5c49-41c8-90d7-091cbc5def4a-node-log\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.616826 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.615818 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dd45f717-ad83-4aad-ba24-2b77778ff926-multus-cni-dir\") pod \"multus-7nsnh\" (UID: \"dd45f717-ad83-4aad-ba24-2b77778ff926\") " pod="openshift-multus/multus-7nsnh" Jul 27 15:53:51.616826 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.615863 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dd45f717-ad83-4aad-ba24-2b77778ff926-host-run-netns\") pod \"multus-7nsnh\" (UID: \"dd45f717-ad83-4aad-ba24-2b77778ff926\") " pod="openshift-multus/multus-7nsnh" Jul 27 15:53:51.616826 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.615888 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a28e8365-5281-405d-aa55-bc4ff9a8b671-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tzdrq\" (UID: \"a28e8365-5281-405d-aa55-bc4ff9a8b671\") " pod="openshift-multus/multus-additional-cni-plugins-tzdrq" Jul 27 15:53:51.616826 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.615914 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dd45f717-ad83-4aad-ba24-2b77778ff926-host-run-k8s-cni-cncf-io\") pod \"multus-7nsnh\" (UID: \"dd45f717-ad83-4aad-ba24-2b77778ff926\") " pod="openshift-multus/multus-7nsnh" Jul 27 15:53:51.616826 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.615939 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7299eae8-57e9-40fa-a73d-6ca4856375de-konnectivity-ca\") pod \"konnectivity-agent-4l8tg\" (UID: \"7299eae8-57e9-40fa-a73d-6ca4856375de\") " pod="kube-system/konnectivity-agent-4l8tg" Jul 27 15:53:51.616826 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.615964 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff-etc-modprobe-d\") pod \"tuned-t7xdc\" (UID: \"ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff\") " pod="openshift-cluster-node-tuning-operator/tuned-t7xdc" Jul 27 15:53:51.616826 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.616003 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff-etc-systemd\") pod \"tuned-t7xdc\" (UID: \"ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff\") " pod="openshift-cluster-node-tuning-operator/tuned-t7xdc" Jul 27 15:53:51.616826 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.616031 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff-var-lib-kubelet\") pod \"tuned-t7xdc\" (UID: \"ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff\") " pod="openshift-cluster-node-tuning-operator/tuned-t7xdc" Jul 27 15:53:51.616826 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.616070 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4110ede3-5c49-41c8-90d7-091cbc5def4a-host-run-netns\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.616826 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.616098 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dd45f717-ad83-4aad-ba24-2b77778ff926-cni-binary-copy\") pod \"multus-7nsnh\" (UID: \"dd45f717-ad83-4aad-ba24-2b77778ff926\") " pod="openshift-multus/multus-7nsnh" Jul 27 15:53:51.616826 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.616121 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd45f717-ad83-4aad-ba24-2b77778ff926-host-var-lib-kubelet\") pod \"multus-7nsnh\" (UID: \"dd45f717-ad83-4aad-ba24-2b77778ff926\") " pod="openshift-multus/multus-7nsnh" Jul 27 15:53:51.616826 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.616152 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf8z9\" (UniqueName: \"kubernetes.io/projected/aadbe564-2de9-44b9-b409-b190bc6f4a26-kube-api-access-vf8z9\") pod \"node-ca-62j4b\" (UID: \"aadbe564-2de9-44b9-b409-b190bc6f4a26\") " pod="openshift-image-registry/node-ca-62j4b" Jul 27 15:53:51.616826 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.616198 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c363121b-53af-4035-86d4-b535c823d3c4-host-slash\") pod \"iptables-alerter-29p88\" (UID: \"c363121b-53af-4035-86d4-b535c823d3c4\") " pod="openshift-network-operator/iptables-alerter-29p88" Jul 27 15:53:51.617446 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.616223 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4110ede3-5c49-41c8-90d7-091cbc5def4a-systemd-units\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.617446 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.616250 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4110ede3-5c49-41c8-90d7-091cbc5def4a-run-ovn\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.617446 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.616274 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dd45f717-ad83-4aad-ba24-2b77778ff926-hostroot\") pod \"multus-7nsnh\" (UID: \"dd45f717-ad83-4aad-ba24-2b77778ff926\") " pod="openshift-multus/multus-7nsnh" Jul 27 15:53:51.617446 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.616298 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff-lib-modules\") pod \"tuned-t7xdc\" (UID: \"ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff\") " pod="openshift-cluster-node-tuning-operator/tuned-t7xdc" Jul 27 15:53:51.617446 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.616324 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dd45f717-ad83-4aad-ba24-2b77778ff926-host-var-lib-cni-bin\") pod \"multus-7nsnh\" (UID: \"dd45f717-ad83-4aad-ba24-2b77778ff926\") " pod="openshift-multus/multus-7nsnh" Jul 27 15:53:51.617446 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.616374 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db554c84-03a7-4127-8c5b-c7c18897237d-original-pull-secret\") pod \"global-pull-secret-syncer-v2tkp\" (UID: \"db554c84-03a7-4127-8c5b-c7c18897237d\") " pod="kube-system/global-pull-secret-syncer-v2tkp" Jul 27 15:53:51.617446 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.616405 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr8xx\" (UniqueName: \"kubernetes.io/projected/a28e8365-5281-405d-aa55-bc4ff9a8b671-kube-api-access-fr8xx\") pod \"multus-additional-cni-plugins-tzdrq\" (UID: \"a28e8365-5281-405d-aa55-bc4ff9a8b671\") " pod="openshift-multus/multus-additional-cni-plugins-tzdrq" Jul 27 15:53:51.617446 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:51.616475 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 15:53:51.617446 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.616517 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4110ede3-5c49-41c8-90d7-091cbc5def4a-env-overrides\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.617446 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:51.616531 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db554c84-03a7-4127-8c5b-c7c18897237d-original-pull-secret podName:db554c84-03a7-4127-8c5b-c7c18897237d nodeName:}" failed. No retries permitted until 2026-07-27 15:53:52.116517469 +0000 UTC m=+2.910243731 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db554c84-03a7-4127-8c5b-c7c18897237d-original-pull-secret") pod "global-pull-secret-syncer-v2tkp" (UID: "db554c84-03a7-4127-8c5b-c7c18897237d") : object "kube-system"/"original-pull-secret" not registered Jul 27 15:53:51.617446 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.616560 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b43e7b7b-4cf8-4ee9-a131-23c2dd05154e-etc-selinux\") pod \"aws-ebs-csi-driver-node-xxd6w\" (UID: \"b43e7b7b-4cf8-4ee9-a131-23c2dd05154e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxd6w" Jul 27 15:53:51.617446 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.616580 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff-tmp\") pod \"tuned-t7xdc\" (UID: \"ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff\") " pod="openshift-cluster-node-tuning-operator/tuned-t7xdc" Jul 27 15:53:51.617446 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.616600 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d8db91e-5711-4fa5-af72-baa451e66451-tmp-dir\") pod \"node-resolver-zf9cg\" (UID: \"8d8db91e-5711-4fa5-af72-baa451e66451\") " pod="openshift-dns/node-resolver-zf9cg" Jul 27 15:53:51.617446 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.616616 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/aadbe564-2de9-44b9-b409-b190bc6f4a26-serviceca\") pod \"node-ca-62j4b\" (UID: \"aadbe564-2de9-44b9-b409-b190bc6f4a26\") " pod="openshift-image-registry/node-ca-62j4b" Jul 27 15:53:51.617446 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.616635 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9lfg\" (UniqueName: \"kubernetes.io/projected/c363121b-53af-4035-86d4-b535c823d3c4-kube-api-access-c9lfg\") pod \"iptables-alerter-29p88\" (UID: \"c363121b-53af-4035-86d4-b535c823d3c4\") " pod="openshift-network-operator/iptables-alerter-29p88" Jul 27 15:53:51.617446 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.616653 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4110ede3-5c49-41c8-90d7-091cbc5def4a-log-socket\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.617947 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.616673 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4110ede3-5c49-41c8-90d7-091cbc5def4a-ovn-node-metrics-cert\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.617947 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.616700 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dd45f717-ad83-4aad-ba24-2b77778ff926-host-var-lib-cni-multus\") pod \"multus-7nsnh\" (UID: \"dd45f717-ad83-4aad-ba24-2b77778ff926\") " pod="openshift-multus/multus-7nsnh" Jul 27 15:53:51.617947 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.616716 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dd45f717-ad83-4aad-ba24-2b77778ff926-multus-conf-dir\") pod \"multus-7nsnh\" (UID: \"dd45f717-ad83-4aad-ba24-2b77778ff926\") " pod="openshift-multus/multus-7nsnh" Jul 27 15:53:51.617947 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.617014 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d8db91e-5711-4fa5-af72-baa451e66451-tmp-dir\") pod \"node-resolver-zf9cg\" (UID: \"8d8db91e-5711-4fa5-af72-baa451e66451\") " pod="openshift-dns/node-resolver-zf9cg" Jul 27 15:53:51.617947 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.617142 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/aadbe564-2de9-44b9-b409-b190bc6f4a26-serviceca\") pod \"node-ca-62j4b\" (UID: \"aadbe564-2de9-44b9-b409-b190bc6f4a26\") " pod="openshift-image-registry/node-ca-62j4b" Jul 27 15:53:51.622280 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.622243 2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 27 15:53:51.625864 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.625832 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vf8z9\" (UniqueName: \"kubernetes.io/projected/aadbe564-2de9-44b9-b409-b190bc6f4a26-kube-api-access-vf8z9\") pod \"node-ca-62j4b\" (UID: \"aadbe564-2de9-44b9-b409-b190bc6f4a26\") " pod="openshift-image-registry/node-ca-62j4b" Jul 27 15:53:51.625990 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.625919 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnwcc\" (UniqueName: \"kubernetes.io/projected/2875ea72-06f8-4c75-b39b-2524b82f6875-kube-api-access-xnwcc\") pod \"network-metrics-daemon-vpk45\" (UID: \"2875ea72-06f8-4c75-b39b-2524b82f6875\") " pod="openshift-multus/network-metrics-daemon-vpk45" Jul 27 15:53:51.625990 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.625932 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpgm9\" (UniqueName: \"kubernetes.io/projected/8d8db91e-5711-4fa5-af72-baa451e66451-kube-api-access-kpgm9\") pod \"node-resolver-zf9cg\" (UID: \"8d8db91e-5711-4fa5-af72-baa451e66451\") " pod="openshift-dns/node-resolver-zf9cg" Jul 27 15:53:51.634647 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.634577 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-4.ec2.internal" event={"ID":"94064bde37d1f180cd8431f305ec203f","Type":"ContainerStarted","Data":"de725c82b69f454f4380b2b65042f2e7ad5fe8012a34947c39627dd342871a6d"} Jul 27 15:53:51.717402 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.717376 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a28e8365-5281-405d-aa55-bc4ff9a8b671-cni-binary-copy\") pod \"multus-additional-cni-plugins-tzdrq\" (UID: \"a28e8365-5281-405d-aa55-bc4ff9a8b671\") " pod="openshift-multus/multus-additional-cni-plugins-tzdrq" Jul 27 15:53:51.717506 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.717413 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff-etc-tuned\") pod \"tuned-t7xdc\" (UID: \"ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff\") " pod="openshift-cluster-node-tuning-operator/tuned-t7xdc" Jul 27 15:53:51.717506 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.717449 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a28e8365-5281-405d-aa55-bc4ff9a8b671-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tzdrq\" (UID: \"a28e8365-5281-405d-aa55-bc4ff9a8b671\") " pod="openshift-multus/multus-additional-cni-plugins-tzdrq" Jul 27 15:53:51.717506 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.717474 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dd45f717-ad83-4aad-ba24-2b77778ff926-cnibin\") pod \"multus-7nsnh\" (UID: \"dd45f717-ad83-4aad-ba24-2b77778ff926\") " pod="openshift-multus/multus-7nsnh" Jul 27 15:53:51.717506 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.717500 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dd45f717-ad83-4aad-ba24-2b77778ff926-multus-socket-dir-parent\") pod \"multus-7nsnh\" (UID: \"dd45f717-ad83-4aad-ba24-2b77778ff926\") " pod="openshift-multus/multus-7nsnh" Jul 27 15:53:51.717709 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.717578 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dd45f717-ad83-4aad-ba24-2b77778ff926-multus-socket-dir-parent\") pod \"multus-7nsnh\" (UID: \"dd45f717-ad83-4aad-ba24-2b77778ff926\") " pod="openshift-multus/multus-7nsnh" Jul 27 15:53:51.717709 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.717598 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd45f717-ad83-4aad-ba24-2b77778ff926-etc-kubernetes\") pod \"multus-7nsnh\" (UID: \"dd45f717-ad83-4aad-ba24-2b77778ff926\") " pod="openshift-multus/multus-7nsnh" Jul 27 15:53:51.717709 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.717649 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dd45f717-ad83-4aad-ba24-2b77778ff926-cnibin\") pod \"multus-7nsnh\" (UID: \"dd45f717-ad83-4aad-ba24-2b77778ff926\") " pod="openshift-multus/multus-7nsnh" Jul 27 15:53:51.717709 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.717653 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b43e7b7b-4cf8-4ee9-a131-23c2dd05154e-registration-dir\") pod \"aws-ebs-csi-driver-node-xxd6w\" (UID: \"b43e7b7b-4cf8-4ee9-a131-23c2dd05154e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxd6w" Jul 27 15:53:51.717937 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.717709 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b43e7b7b-4cf8-4ee9-a131-23c2dd05154e-registration-dir\") pod \"aws-ebs-csi-driver-node-xxd6w\" (UID: \"b43e7b7b-4cf8-4ee9-a131-23c2dd05154e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxd6w" Jul 27 15:53:51.717937 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.717712 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd45f717-ad83-4aad-ba24-2b77778ff926-etc-kubernetes\") pod \"multus-7nsnh\" (UID: \"dd45f717-ad83-4aad-ba24-2b77778ff926\") " pod="openshift-multus/multus-7nsnh" Jul 27 15:53:51.717937 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.717733 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff-sys\") pod \"tuned-t7xdc\" (UID: \"ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff\") " pod="openshift-cluster-node-tuning-operator/tuned-t7xdc" Jul 27 15:53:51.717937 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.717783 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7299eae8-57e9-40fa-a73d-6ca4856375de-agent-certs\") pod \"konnectivity-agent-4l8tg\" (UID: \"7299eae8-57e9-40fa-a73d-6ca4856375de\") " pod="kube-system/konnectivity-agent-4l8tg" Jul 27 15:53:51.717937 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.717828 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b43e7b7b-4cf8-4ee9-a131-23c2dd05154e-socket-dir\") pod \"aws-ebs-csi-driver-node-xxd6w\" (UID: \"b43e7b7b-4cf8-4ee9-a131-23c2dd05154e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxd6w" Jul 27 15:53:51.717937 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.717833 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff-sys\") pod \"tuned-t7xdc\" (UID: \"ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff\") " pod="openshift-cluster-node-tuning-operator/tuned-t7xdc" Jul 27 15:53:51.717937 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.717874 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a28e8365-5281-405d-aa55-bc4ff9a8b671-os-release\") pod \"multus-additional-cni-plugins-tzdrq\" (UID: \"a28e8365-5281-405d-aa55-bc4ff9a8b671\") " pod="openshift-multus/multus-additional-cni-plugins-tzdrq" Jul 27 15:53:51.717937 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.717904 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4110ede3-5c49-41c8-90d7-091cbc5def4a-var-lib-openvswitch\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.717937 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.717932 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4110ede3-5c49-41c8-90d7-091cbc5def4a-node-log\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.718429 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.717950 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b43e7b7b-4cf8-4ee9-a131-23c2dd05154e-socket-dir\") pod \"aws-ebs-csi-driver-node-xxd6w\" (UID: \"b43e7b7b-4cf8-4ee9-a131-23c2dd05154e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxd6w" Jul 27 15:53:51.718429 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.717961 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dd45f717-ad83-4aad-ba24-2b77778ff926-multus-cni-dir\") pod \"multus-7nsnh\" (UID: \"dd45f717-ad83-4aad-ba24-2b77778ff926\") " pod="openshift-multus/multus-7nsnh" Jul 27 15:53:51.718429 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.718003 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a28e8365-5281-405d-aa55-bc4ff9a8b671-os-release\") pod \"multus-additional-cni-plugins-tzdrq\" (UID: \"a28e8365-5281-405d-aa55-bc4ff9a8b671\") " pod="openshift-multus/multus-additional-cni-plugins-tzdrq" Jul 27 15:53:51.718429 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.718010 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dd45f717-ad83-4aad-ba24-2b77778ff926-host-run-netns\") pod \"multus-7nsnh\" (UID: \"dd45f717-ad83-4aad-ba24-2b77778ff926\") " pod="openshift-multus/multus-7nsnh" Jul 27 15:53:51.718429 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.718027 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dd45f717-ad83-4aad-ba24-2b77778ff926-multus-cni-dir\") pod \"multus-7nsnh\" (UID: \"dd45f717-ad83-4aad-ba24-2b77778ff926\") " pod="openshift-multus/multus-7nsnh" Jul 27 15:53:51.718429 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.718044 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dd45f717-ad83-4aad-ba24-2b77778ff926-host-run-netns\") pod \"multus-7nsnh\" (UID: \"dd45f717-ad83-4aad-ba24-2b77778ff926\") " pod="openshift-multus/multus-7nsnh" Jul 27 15:53:51.718429 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.718061 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a28e8365-5281-405d-aa55-bc4ff9a8b671-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tzdrq\" (UID: \"a28e8365-5281-405d-aa55-bc4ff9a8b671\") " pod="openshift-multus/multus-additional-cni-plugins-tzdrq" Jul 27 15:53:51.718429 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.718090 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dd45f717-ad83-4aad-ba24-2b77778ff926-host-run-k8s-cni-cncf-io\") pod \"multus-7nsnh\" (UID: \"dd45f717-ad83-4aad-ba24-2b77778ff926\") " pod="openshift-multus/multus-7nsnh" Jul 27 15:53:51.718429 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.718118 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7299eae8-57e9-40fa-a73d-6ca4856375de-konnectivity-ca\") pod \"konnectivity-agent-4l8tg\" (UID: \"7299eae8-57e9-40fa-a73d-6ca4856375de\") " pod="kube-system/konnectivity-agent-4l8tg" Jul 27 15:53:51.718429 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.718146 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff-etc-modprobe-d\") pod \"tuned-t7xdc\" (UID: \"ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff\") " pod="openshift-cluster-node-tuning-operator/tuned-t7xdc" Jul 27 15:53:51.718429 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.718161 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a28e8365-5281-405d-aa55-bc4ff9a8b671-cni-binary-copy\") pod \"multus-additional-cni-plugins-tzdrq\" (UID: \"a28e8365-5281-405d-aa55-bc4ff9a8b671\") " pod="openshift-multus/multus-additional-cni-plugins-tzdrq" Jul 27 15:53:51.718429 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.718091 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4110ede3-5c49-41c8-90d7-091cbc5def4a-node-log\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.718429 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.718169 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff-etc-systemd\") pod \"tuned-t7xdc\" (UID: \"ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff\") " pod="openshift-cluster-node-tuning-operator/tuned-t7xdc" Jul 27 15:53:51.718429 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.718210 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff-var-lib-kubelet\") pod \"tuned-t7xdc\" (UID: \"ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff\") " pod="openshift-cluster-node-tuning-operator/tuned-t7xdc" Jul 27 15:53:51.718429 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.718237 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4110ede3-5c49-41c8-90d7-091cbc5def4a-host-run-netns\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.718429 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.718264 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dd45f717-ad83-4aad-ba24-2b77778ff926-cni-binary-copy\") pod \"multus-7nsnh\" (UID: \"dd45f717-ad83-4aad-ba24-2b77778ff926\") " pod="openshift-multus/multus-7nsnh" Jul 27 15:53:51.718429 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.718290 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd45f717-ad83-4aad-ba24-2b77778ff926-host-var-lib-kubelet\") pod \"multus-7nsnh\" (UID: \"dd45f717-ad83-4aad-ba24-2b77778ff926\") " pod="openshift-multus/multus-7nsnh" Jul 27 15:53:51.718429 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.718296 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dd45f717-ad83-4aad-ba24-2b77778ff926-host-run-k8s-cni-cncf-io\") pod \"multus-7nsnh\" (UID: \"dd45f717-ad83-4aad-ba24-2b77778ff926\") " pod="openshift-multus/multus-7nsnh" Jul 27 15:53:51.719247 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.718321 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c363121b-53af-4035-86d4-b535c823d3c4-host-slash\") pod \"iptables-alerter-29p88\" (UID: \"c363121b-53af-4035-86d4-b535c823d3c4\") " pod="openshift-network-operator/iptables-alerter-29p88" Jul 27 15:53:51.719247 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.718343 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4110ede3-5c49-41c8-90d7-091cbc5def4a-host-run-netns\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.719247 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.718347 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4110ede3-5c49-41c8-90d7-091cbc5def4a-systemd-units\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.719247 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.718375 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4110ede3-5c49-41c8-90d7-091cbc5def4a-run-ovn\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.719247 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.718403 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dd45f717-ad83-4aad-ba24-2b77778ff926-hostroot\") pod \"multus-7nsnh\" (UID: \"dd45f717-ad83-4aad-ba24-2b77778ff926\") " pod="openshift-multus/multus-7nsnh" Jul 27 15:53:51.719247 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.718432 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff-lib-modules\") pod \"tuned-t7xdc\" (UID: \"ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff\") " pod="openshift-cluster-node-tuning-operator/tuned-t7xdc" Jul 27 15:53:51.719247 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.718504 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4110ede3-5c49-41c8-90d7-091cbc5def4a-var-lib-openvswitch\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.719247 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.718554 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dd45f717-ad83-4aad-ba24-2b77778ff926-host-var-lib-cni-bin\") pod \"multus-7nsnh\" (UID: \"dd45f717-ad83-4aad-ba24-2b77778ff926\") " pod="openshift-multus/multus-7nsnh" Jul 27 15:53:51.719247 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.718572 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff-lib-modules\") pod \"tuned-t7xdc\" (UID: \"ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff\") " pod="openshift-cluster-node-tuning-operator/tuned-t7xdc" Jul 27 15:53:51.719247 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.718593 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a28e8365-5281-405d-aa55-bc4ff9a8b671-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tzdrq\" (UID: \"a28e8365-5281-405d-aa55-bc4ff9a8b671\") " pod="openshift-multus/multus-additional-cni-plugins-tzdrq" Jul 27 15:53:51.719247 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.718610 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fr8xx\" (UniqueName: \"kubernetes.io/projected/a28e8365-5281-405d-aa55-bc4ff9a8b671-kube-api-access-fr8xx\") pod \"multus-additional-cni-plugins-tzdrq\" (UID: \"a28e8365-5281-405d-aa55-bc4ff9a8b671\") " pod="openshift-multus/multus-additional-cni-plugins-tzdrq" Jul 27 15:53:51.719247 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.718265 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff-etc-modprobe-d\") pod \"tuned-t7xdc\" (UID: \"ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff\") " pod="openshift-cluster-node-tuning-operator/tuned-t7xdc" Jul 27 15:53:51.719247 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.718675 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd45f717-ad83-4aad-ba24-2b77778ff926-host-var-lib-kubelet\") pod \"multus-7nsnh\" (UID: \"dd45f717-ad83-4aad-ba24-2b77778ff926\") " pod="openshift-multus/multus-7nsnh" Jul 27 15:53:51.719247 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.718641 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4110ede3-5c49-41c8-90d7-091cbc5def4a-env-overrides\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.719247 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.718724 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b43e7b7b-4cf8-4ee9-a131-23c2dd05154e-etc-selinux\") pod \"aws-ebs-csi-driver-node-xxd6w\" (UID: \"b43e7b7b-4cf8-4ee9-a131-23c2dd05154e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxd6w" Jul 27 15:53:51.719247 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.718751 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff-tmp\") pod \"tuned-t7xdc\" (UID: \"ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff\") " pod="openshift-cluster-node-tuning-operator/tuned-t7xdc" Jul 27 15:53:51.719247 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.718780 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9lfg\" (UniqueName: \"kubernetes.io/projected/c363121b-53af-4035-86d4-b535c823d3c4-kube-api-access-c9lfg\") pod \"iptables-alerter-29p88\" (UID: \"c363121b-53af-4035-86d4-b535c823d3c4\") " pod="openshift-network-operator/iptables-alerter-29p88" Jul 27 15:53:51.720108 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.718819 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4110ede3-5c49-41c8-90d7-091cbc5def4a-log-socket\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.720108 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.718878 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4110ede3-5c49-41c8-90d7-091cbc5def4a-run-ovn\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.720108 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.718875 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4110ede3-5c49-41c8-90d7-091cbc5def4a-ovn-node-metrics-cert\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.720108 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.718920 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dd45f717-ad83-4aad-ba24-2b77778ff926-host-var-lib-cni-multus\") pod \"multus-7nsnh\" (UID: \"dd45f717-ad83-4aad-ba24-2b77778ff926\") " pod="openshift-multus/multus-7nsnh" Jul 27 15:53:51.720108 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.718928 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4110ede3-5c49-41c8-90d7-091cbc5def4a-systemd-units\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.720108 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.718387 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff-etc-systemd\") pod \"tuned-t7xdc\" (UID: \"ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff\") " pod="openshift-cluster-node-tuning-operator/tuned-t7xdc" Jul 27 15:53:51.720108 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.718946 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dd45f717-ad83-4aad-ba24-2b77778ff926-multus-conf-dir\") pod \"multus-7nsnh\" (UID: \"dd45f717-ad83-4aad-ba24-2b77778ff926\") " pod="openshift-multus/multus-7nsnh" Jul 27 15:53:51.720108 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.718978 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dd45f717-ad83-4aad-ba24-2b77778ff926-host-run-multus-certs\") pod \"multus-7nsnh\" (UID: \"dd45f717-ad83-4aad-ba24-2b77778ff926\") " pod="openshift-multus/multus-7nsnh" Jul 27 15:53:51.720108 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.718984 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dd45f717-ad83-4aad-ba24-2b77778ff926-hostroot\") pod \"multus-7nsnh\" (UID: \"dd45f717-ad83-4aad-ba24-2b77778ff926\") " pod="openshift-multus/multus-7nsnh" Jul 27 15:53:51.720108 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.718993 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff-var-lib-kubelet\") pod \"tuned-t7xdc\" (UID: \"ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff\") " pod="openshift-cluster-node-tuning-operator/tuned-t7xdc" Jul 27 15:53:51.720108 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.718779 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7299eae8-57e9-40fa-a73d-6ca4856375de-konnectivity-ca\") pod \"konnectivity-agent-4l8tg\" (UID: \"7299eae8-57e9-40fa-a73d-6ca4856375de\") " pod="kube-system/konnectivity-agent-4l8tg" Jul 27 15:53:51.720108 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.719019 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4110ede3-5c49-41c8-90d7-091cbc5def4a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.720108 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.719055 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff-host\") pod \"tuned-t7xdc\" (UID: \"ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff\") " pod="openshift-cluster-node-tuning-operator/tuned-t7xdc" Jul 27 15:53:51.720108 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.719089 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlds4\" (UniqueName: \"kubernetes.io/projected/b43e7b7b-4cf8-4ee9-a131-23c2dd05154e-kube-api-access-hlds4\") pod \"aws-ebs-csi-driver-node-xxd6w\" (UID: \"b43e7b7b-4cf8-4ee9-a131-23c2dd05154e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxd6w" Jul 27 15:53:51.720108 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.719104 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b43e7b7b-4cf8-4ee9-a131-23c2dd05154e-etc-selinux\") pod \"aws-ebs-csi-driver-node-xxd6w\" (UID: \"b43e7b7b-4cf8-4ee9-a131-23c2dd05154e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxd6w" Jul 27 15:53:51.720108 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.719118 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff-etc-sysctl-conf\") pod \"tuned-t7xdc\" (UID: \"ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff\") " pod="openshift-cluster-node-tuning-operator/tuned-t7xdc" Jul 27 15:53:51.720108 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.719146 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g84h8\" (UniqueName: \"kubernetes.io/projected/ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff-kube-api-access-g84h8\") pod \"tuned-t7xdc\" (UID: \"ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff\") " pod="openshift-cluster-node-tuning-operator/tuned-t7xdc" Jul 27 15:53:51.721069 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.719174 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4110ede3-5c49-41c8-90d7-091cbc5def4a-run-systemd\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.721069 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.719202 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4110ede3-5c49-41c8-90d7-091cbc5def4a-ovnkube-config\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.721069 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.719231 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dd45f717-ad83-4aad-ba24-2b77778ff926-cni-binary-copy\") pod \"multus-7nsnh\" (UID: \"dd45f717-ad83-4aad-ba24-2b77778ff926\") " pod="openshift-multus/multus-7nsnh" Jul 27 15:53:51.721069 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.719281 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4110ede3-5c49-41c8-90d7-091cbc5def4a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.721069 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.719287 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a28e8365-5281-405d-aa55-bc4ff9a8b671-cnibin\") pod \"multus-additional-cni-plugins-tzdrq\" (UID: \"a28e8365-5281-405d-aa55-bc4ff9a8b671\") " pod="openshift-multus/multus-additional-cni-plugins-tzdrq" Jul 27 15:53:51.721069 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.719024 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dd45f717-ad83-4aad-ba24-2b77778ff926-host-run-multus-certs\") pod \"multus-7nsnh\" (UID: \"dd45f717-ad83-4aad-ba24-2b77778ff926\") " pod="openshift-multus/multus-7nsnh" Jul 27 15:53:51.721069 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.719235 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a28e8365-5281-405d-aa55-bc4ff9a8b671-cnibin\") pod \"multus-additional-cni-plugins-tzdrq\" (UID: \"a28e8365-5281-405d-aa55-bc4ff9a8b671\") " pod="openshift-multus/multus-additional-cni-plugins-tzdrq" Jul 27 15:53:51.721069 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.719340 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4110ede3-5c49-41c8-90d7-091cbc5def4a-host-kubelet\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.721069 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.719348 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff-host\") pod \"tuned-t7xdc\" (UID: \"ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff\") " pod="openshift-cluster-node-tuning-operator/tuned-t7xdc" Jul 27 15:53:51.721069 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.719374 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4110ede3-5c49-41c8-90d7-091cbc5def4a-etc-openvswitch\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.721069 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.719400 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4110ede3-5c49-41c8-90d7-091cbc5def4a-host-cni-netd\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.721069 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.719429 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff-etc-kubernetes\") pod \"tuned-t7xdc\" (UID: \"ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff\") " pod="openshift-cluster-node-tuning-operator/tuned-t7xdc" Jul 27 15:53:51.721069 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.719461 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff-etc-sysctl-d\") pod \"tuned-t7xdc\" (UID: \"ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff\") " pod="openshift-cluster-node-tuning-operator/tuned-t7xdc" Jul 27 15:53:51.721069 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.719491 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a28e8365-5281-405d-aa55-bc4ff9a8b671-system-cni-dir\") pod \"multus-additional-cni-plugins-tzdrq\" (UID: \"a28e8365-5281-405d-aa55-bc4ff9a8b671\") " pod="openshift-multus/multus-additional-cni-plugins-tzdrq" Jul 27 15:53:51.721069 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.719523 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4110ede3-5c49-41c8-90d7-091cbc5def4a-host-run-ovn-kubernetes\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.721069 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.719555 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4110ede3-5c49-41c8-90d7-091cbc5def4a-ovnkube-script-lib\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.721069 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.719594 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b43e7b7b-4cf8-4ee9-a131-23c2dd05154e-device-dir\") pod \"aws-ebs-csi-driver-node-xxd6w\" (UID: \"b43e7b7b-4cf8-4ee9-a131-23c2dd05154e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxd6w" Jul 27 15:53:51.721778 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.719633 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b43e7b7b-4cf8-4ee9-a131-23c2dd05154e-sys-fs\") pod \"aws-ebs-csi-driver-node-xxd6w\" (UID: \"b43e7b7b-4cf8-4ee9-a131-23c2dd05154e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxd6w" Jul 27 15:53:51.721778 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.719664 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff-etc-sysconfig\") pod \"tuned-t7xdc\" (UID: \"ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff\") " pod="openshift-cluster-node-tuning-operator/tuned-t7xdc" Jul 27 15:53:51.721778 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.719696 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff-run\") pod \"tuned-t7xdc\" (UID: \"ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff\") " pod="openshift-cluster-node-tuning-operator/tuned-t7xdc" Jul 27 15:53:51.721778 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.719728 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dd45f717-ad83-4aad-ba24-2b77778ff926-os-release\") pod \"multus-7nsnh\" (UID: \"dd45f717-ad83-4aad-ba24-2b77778ff926\") " pod="openshift-multus/multus-7nsnh" Jul 27 15:53:51.721778 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.719762 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c363121b-53af-4035-86d4-b535c823d3c4-iptables-alerter-script\") pod \"iptables-alerter-29p88\" (UID: \"c363121b-53af-4035-86d4-b535c823d3c4\") " pod="openshift-network-operator/iptables-alerter-29p88" Jul 27 15:53:51.721778 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.719797 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4110ede3-5c49-41c8-90d7-091cbc5def4a-host-cni-bin\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.721778 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.719828 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dd45f717-ad83-4aad-ba24-2b77778ff926-system-cni-dir\") pod \"multus-7nsnh\" (UID: \"dd45f717-ad83-4aad-ba24-2b77778ff926\") " pod="openshift-multus/multus-7nsnh" Jul 27 15:53:51.721778 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.719855 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcc98\" (UniqueName: \"kubernetes.io/projected/dd45f717-ad83-4aad-ba24-2b77778ff926-kube-api-access-qcc98\") pod \"multus-7nsnh\" (UID: \"dd45f717-ad83-4aad-ba24-2b77778ff926\") " pod="openshift-multus/multus-7nsnh" Jul 27 15:53:51.721778 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.719896 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsdnn\" (UniqueName: \"kubernetes.io/projected/26984101-b8ab-4b8c-9272-2cc91f0e2ee9-kube-api-access-rsdnn\") pod \"network-check-target-6khtd\" (UID: \"26984101-b8ab-4b8c-9272-2cc91f0e2ee9\") " pod="openshift-network-diagnostics/network-check-target-6khtd" Jul 27 15:53:51.721778 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.719925 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a28e8365-5281-405d-aa55-bc4ff9a8b671-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tzdrq\" (UID: \"a28e8365-5281-405d-aa55-bc4ff9a8b671\") " pod="openshift-multus/multus-additional-cni-plugins-tzdrq" Jul 27 15:53:51.721778 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.719949 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4110ede3-5c49-41c8-90d7-091cbc5def4a-host-slash\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.721778 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.719976 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4110ede3-5c49-41c8-90d7-091cbc5def4a-run-openvswitch\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.721778 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.720002 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxzhr\" (UniqueName: \"kubernetes.io/projected/4110ede3-5c49-41c8-90d7-091cbc5def4a-kube-api-access-mxzhr\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.721778 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.720008 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4110ede3-5c49-41c8-90d7-091cbc5def4a-log-socket\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.721778 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.720034 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dd45f717-ad83-4aad-ba24-2b77778ff926-multus-daemon-config\") pod \"multus-7nsnh\" (UID: \"dd45f717-ad83-4aad-ba24-2b77778ff926\") " pod="openshift-multus/multus-7nsnh" Jul 27 15:53:51.721778 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.720060 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b43e7b7b-4cf8-4ee9-a131-23c2dd05154e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xxd6w\" (UID: \"b43e7b7b-4cf8-4ee9-a131-23c2dd05154e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxd6w" Jul 27 15:53:51.721778 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.720730 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4110ede3-5c49-41c8-90d7-091cbc5def4a-env-overrides\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.722439 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.720874 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dd45f717-ad83-4aad-ba24-2b77778ff926-host-var-lib-cni-bin\") pod \"multus-7nsnh\" (UID: \"dd45f717-ad83-4aad-ba24-2b77778ff926\") " pod="openshift-multus/multus-7nsnh" Jul 27 15:53:51.722439 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.720938 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b43e7b7b-4cf8-4ee9-a131-23c2dd05154e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xxd6w\" (UID: \"b43e7b7b-4cf8-4ee9-a131-23c2dd05154e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxd6w" Jul 27 15:53:51.722439 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.721185 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c363121b-53af-4035-86d4-b535c823d3c4-host-slash\") pod \"iptables-alerter-29p88\" (UID: \"c363121b-53af-4035-86d4-b535c823d3c4\") " pod="openshift-network-operator/iptables-alerter-29p88" Jul 27 15:53:51.722439 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.721790 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a28e8365-5281-405d-aa55-bc4ff9a8b671-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tzdrq\" (UID: \"a28e8365-5281-405d-aa55-bc4ff9a8b671\") " pod="openshift-multus/multus-additional-cni-plugins-tzdrq" Jul 27 15:53:51.722439 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.721930 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4110ede3-5c49-41c8-90d7-091cbc5def4a-ovn-node-metrics-cert\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.722439 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.721979 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff-etc-tuned\") pod \"tuned-t7xdc\" (UID: \"ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff\") " pod="openshift-cluster-node-tuning-operator/tuned-t7xdc" Jul 27 15:53:51.722439 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.722123 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff-tmp\") pod \"tuned-t7xdc\" (UID: \"ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff\") " pod="openshift-cluster-node-tuning-operator/tuned-t7xdc" Jul 27 15:53:51.722439 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.722221 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dd45f717-ad83-4aad-ba24-2b77778ff926-host-var-lib-cni-multus\") pod \"multus-7nsnh\" (UID: \"dd45f717-ad83-4aad-ba24-2b77778ff926\") " pod="openshift-multus/multus-7nsnh" Jul 27 15:53:51.722819 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.722551 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff-etc-sysctl-conf\") pod \"tuned-t7xdc\" (UID: \"ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff\") " pod="openshift-cluster-node-tuning-operator/tuned-t7xdc" Jul 27 15:53:51.722819 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.722648 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff-run\") pod \"tuned-t7xdc\" (UID: \"ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff\") " pod="openshift-cluster-node-tuning-operator/tuned-t7xdc" Jul 27 15:53:51.723379 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.723354 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b43e7b7b-4cf8-4ee9-a131-23c2dd05154e-sys-fs\") pod \"aws-ebs-csi-driver-node-xxd6w\" (UID: \"b43e7b7b-4cf8-4ee9-a131-23c2dd05154e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxd6w" Jul 27 15:53:51.723480 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.723376 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4110ede3-5c49-41c8-90d7-091cbc5def4a-host-cni-bin\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.723480 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.723378 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b43e7b7b-4cf8-4ee9-a131-23c2dd05154e-device-dir\") pod \"aws-ebs-csi-driver-node-xxd6w\" (UID: \"b43e7b7b-4cf8-4ee9-a131-23c2dd05154e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxd6w" Jul 27 15:53:51.723480 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.723435 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4110ede3-5c49-41c8-90d7-091cbc5def4a-host-kubelet\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.723480 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.723441 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff-etc-sysconfig\") pod \"tuned-t7xdc\" (UID: \"ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff\") " pod="openshift-cluster-node-tuning-operator/tuned-t7xdc" Jul 27 15:53:51.723480 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.723460 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dd45f717-ad83-4aad-ba24-2b77778ff926-system-cni-dir\") pod \"multus-7nsnh\" (UID: \"dd45f717-ad83-4aad-ba24-2b77778ff926\") " pod="openshift-multus/multus-7nsnh" Jul 27 15:53:51.723744 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.723484 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dd45f717-ad83-4aad-ba24-2b77778ff926-multus-conf-dir\") pod \"multus-7nsnh\" (UID: \"dd45f717-ad83-4aad-ba24-2b77778ff926\") " pod="openshift-multus/multus-7nsnh" Jul 27 15:53:51.723744 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.723490 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4110ede3-5c49-41c8-90d7-091cbc5def4a-etc-openvswitch\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.723744 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.723527 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4110ede3-5c49-41c8-90d7-091cbc5def4a-host-cni-netd\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.723744 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.723578 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff-etc-kubernetes\") pod \"tuned-t7xdc\" (UID: \"ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff\") " pod="openshift-cluster-node-tuning-operator/tuned-t7xdc" Jul 27 15:53:51.723744 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.723680 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff-etc-sysctl-d\") pod \"tuned-t7xdc\" (UID: \"ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff\") " pod="openshift-cluster-node-tuning-operator/tuned-t7xdc" Jul 27 15:53:51.724174 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.723753 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4110ede3-5c49-41c8-90d7-091cbc5def4a-host-run-ovn-kubernetes\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.724174 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.723923 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7299eae8-57e9-40fa-a73d-6ca4856375de-agent-certs\") pod \"konnectivity-agent-4l8tg\" (UID: \"7299eae8-57e9-40fa-a73d-6ca4856375de\") " pod="kube-system/konnectivity-agent-4l8tg" Jul 27 15:53:51.724174 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.724005 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dd45f717-ad83-4aad-ba24-2b77778ff926-os-release\") pod \"multus-7nsnh\" (UID: \"dd45f717-ad83-4aad-ba24-2b77778ff926\") " pod="openshift-multus/multus-7nsnh" Jul 27 15:53:51.724174 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.724044 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a28e8365-5281-405d-aa55-bc4ff9a8b671-system-cni-dir\") pod \"multus-additional-cni-plugins-tzdrq\" (UID: \"a28e8365-5281-405d-aa55-bc4ff9a8b671\") " pod="openshift-multus/multus-additional-cni-plugins-tzdrq" Jul 27 15:53:51.724420 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.724317 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4110ede3-5c49-41c8-90d7-091cbc5def4a-ovnkube-script-lib\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.724482 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.724465 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4110ede3-5c49-41c8-90d7-091cbc5def4a-run-openvswitch\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.724644 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.724624 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a28e8365-5281-405d-aa55-bc4ff9a8b671-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tzdrq\" (UID: \"a28e8365-5281-405d-aa55-bc4ff9a8b671\") " pod="openshift-multus/multus-additional-cni-plugins-tzdrq" Jul 27 15:53:51.724709 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.724659 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c363121b-53af-4035-86d4-b535c823d3c4-iptables-alerter-script\") pod \"iptables-alerter-29p88\" (UID: \"c363121b-53af-4035-86d4-b535c823d3c4\") " pod="openshift-network-operator/iptables-alerter-29p88" Jul 27 15:53:51.724709 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.724689 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4110ede3-5c49-41c8-90d7-091cbc5def4a-host-slash\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.724814 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.724733 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4110ede3-5c49-41c8-90d7-091cbc5def4a-run-systemd\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.725245 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.725219 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4110ede3-5c49-41c8-90d7-091cbc5def4a-ovnkube-config\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.725875 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.725385 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dd45f717-ad83-4aad-ba24-2b77778ff926-multus-daemon-config\") pod \"multus-7nsnh\" (UID: \"dd45f717-ad83-4aad-ba24-2b77778ff926\") " pod="openshift-multus/multus-7nsnh" Jul 27 15:53:51.730872 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:51.730850 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 15:53:51.730872 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:51.730870 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 15:53:51.731056 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:51.730900 2561 projected.go:196] Error preparing data for projected volume kube-api-access-rsdnn for pod openshift-network-diagnostics/network-check-target-6khtd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 15:53:51.731056 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:51.730963 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/26984101-b8ab-4b8c-9272-2cc91f0e2ee9-kube-api-access-rsdnn podName:26984101-b8ab-4b8c-9272-2cc91f0e2ee9 nodeName:}" failed. No retries permitted until 2026-07-27 15:53:52.230947549 +0000 UTC m=+3.024673811 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rsdnn" (UniqueName: "kubernetes.io/projected/26984101-b8ab-4b8c-9272-2cc91f0e2ee9-kube-api-access-rsdnn") pod "network-check-target-6khtd" (UID: "26984101-b8ab-4b8c-9272-2cc91f0e2ee9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 15:53:51.731469 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.731440 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr8xx\" (UniqueName: \"kubernetes.io/projected/a28e8365-5281-405d-aa55-bc4ff9a8b671-kube-api-access-fr8xx\") pod \"multus-additional-cni-plugins-tzdrq\" (UID: \"a28e8365-5281-405d-aa55-bc4ff9a8b671\") " pod="openshift-multus/multus-additional-cni-plugins-tzdrq" Jul 27 15:53:51.731566 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.731540 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9lfg\" (UniqueName: \"kubernetes.io/projected/c363121b-53af-4035-86d4-b535c823d3c4-kube-api-access-c9lfg\") pod \"iptables-alerter-29p88\" (UID: \"c363121b-53af-4035-86d4-b535c823d3c4\") " pod="openshift-network-operator/iptables-alerter-29p88" Jul 27 15:53:51.731661 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.731642 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlds4\" (UniqueName: \"kubernetes.io/projected/b43e7b7b-4cf8-4ee9-a131-23c2dd05154e-kube-api-access-hlds4\") pod \"aws-ebs-csi-driver-node-xxd6w\" (UID: \"b43e7b7b-4cf8-4ee9-a131-23c2dd05154e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxd6w" Jul 27 15:53:51.733508 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.733482 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g84h8\" (UniqueName: \"kubernetes.io/projected/ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff-kube-api-access-g84h8\") pod \"tuned-t7xdc\" (UID: \"ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff\") " pod="openshift-cluster-node-tuning-operator/tuned-t7xdc" Jul 27 15:53:51.734336 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.734311 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcc98\" (UniqueName: \"kubernetes.io/projected/dd45f717-ad83-4aad-ba24-2b77778ff926-kube-api-access-qcc98\") pod \"multus-7nsnh\" (UID: \"dd45f717-ad83-4aad-ba24-2b77778ff926\") " pod="openshift-multus/multus-7nsnh" Jul 27 15:53:51.734413 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.734359 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxzhr\" (UniqueName: \"kubernetes.io/projected/4110ede3-5c49-41c8-90d7-091cbc5def4a-kube-api-access-mxzhr\") pod \"ovnkube-node-8mnsv\" (UID: \"4110ede3-5c49-41c8-90d7-091cbc5def4a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.820640 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.820534 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zf9cg" Jul 27 15:53:51.831644 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:51.831607 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d8db91e_5711_4fa5_af72_baa451e66451.slice/crio-36cbfad8340bab21def4549f9e033238cba284ebfa84f188e51748f5bc914d68 WatchSource:0}: Error finding container 36cbfad8340bab21def4549f9e033238cba284ebfa84f188e51748f5bc914d68: Status 404 returned error can't find the container with id 36cbfad8340bab21def4549f9e033238cba284ebfa84f188e51748f5bc914d68 Jul 27 15:53:51.844303 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.844263 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-62j4b" Jul 27 15:53:51.853556 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.853530 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7nsnh" Jul 27 15:53:51.853884 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:51.853858 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaadbe564_2de9_44b9_b409_b190bc6f4a26.slice/crio-0f9fc7d40a01ce2ee3558e1cb9c3d9610ea296623be69fef6ee0d2c38e385d14 WatchSource:0}: Error finding container 0f9fc7d40a01ce2ee3558e1cb9c3d9610ea296623be69fef6ee0d2c38e385d14: Status 404 returned error can't find the container with id 0f9fc7d40a01ce2ee3558e1cb9c3d9610ea296623be69fef6ee0d2c38e385d14 Jul 27 15:53:51.857717 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.857696 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tzdrq" Jul 27 15:53:51.862921 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:51.862896 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd45f717_ad83_4aad_ba24_2b77778ff926.slice/crio-9260554e9ccbd5e4f8620747253510f1a0b855dd8e92ffd21da82f1cd61d626f WatchSource:0}: Error finding container 9260554e9ccbd5e4f8620747253510f1a0b855dd8e92ffd21da82f1cd61d626f: Status 404 returned error can't find the container with id 9260554e9ccbd5e4f8620747253510f1a0b855dd8e92ffd21da82f1cd61d626f Jul 27 15:53:51.866964 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.866939 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-29p88" Jul 27 15:53:51.869129 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:51.869099 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda28e8365_5281_405d_aa55_bc4ff9a8b671.slice/crio-dd9c54351a8dae7568621594e08a45ca259dbfca68242f65c592784805ea0c2c WatchSource:0}: Error finding container dd9c54351a8dae7568621594e08a45ca259dbfca68242f65c592784805ea0c2c: Status 404 returned error can't find the container with id dd9c54351a8dae7568621594e08a45ca259dbfca68242f65c592784805ea0c2c Jul 27 15:53:51.873546 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.873518 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:53:51.877390 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:51.877364 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc363121b_53af_4035_86d4_b535c823d3c4.slice/crio-3842b6188499f2e4ef3317dbe1be4f6bd1b43471498c5f5b44aea8c2d279f646 WatchSource:0}: Error finding container 3842b6188499f2e4ef3317dbe1be4f6bd1b43471498c5f5b44aea8c2d279f646: Status 404 returned error can't find the container with id 3842b6188499f2e4ef3317dbe1be4f6bd1b43471498c5f5b44aea8c2d279f646 Jul 27 15:53:51.879612 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.879589 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4l8tg" Jul 27 15:53:51.884021 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:51.883995 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4110ede3_5c49_41c8_90d7_091cbc5def4a.slice/crio-1a0519d86fa01e84410d0a064fbee470aef3869ae485e0e5f3e96ccdcf32d30a WatchSource:0}: Error finding container 1a0519d86fa01e84410d0a064fbee470aef3869ae485e0e5f3e96ccdcf32d30a: Status 404 returned error can't find the container with id 1a0519d86fa01e84410d0a064fbee470aef3869ae485e0e5f3e96ccdcf32d30a Jul 27 15:53:51.885125 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.885107 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxd6w" Jul 27 15:53:51.890318 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:51.890295 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-t7xdc" Jul 27 15:53:51.890484 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:51.890462 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7299eae8_57e9_40fa_a73d_6ca4856375de.slice/crio-7f31314f1f002a0a1dae8bb1a79dd6ffb4b2d02c0213e49eabff8083048be8e3 WatchSource:0}: Error finding container 7f31314f1f002a0a1dae8bb1a79dd6ffb4b2d02c0213e49eabff8083048be8e3: Status 404 returned error can't find the container with id 7f31314f1f002a0a1dae8bb1a79dd6ffb4b2d02c0213e49eabff8083048be8e3 Jul 27 15:53:51.897590 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:51.897562 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb43e7b7b_4cf8_4ee9_a131_23c2dd05154e.slice/crio-d98bb054e102644e18733d21986013989d91e31e6c65b97ebb1ec5797734e594 WatchSource:0}: Error finding container d98bb054e102644e18733d21986013989d91e31e6c65b97ebb1ec5797734e594: Status 404 returned error can't find the container with id d98bb054e102644e18733d21986013989d91e31e6c65b97ebb1ec5797734e594 Jul 27 15:53:51.902311 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:53:51.902283 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef66b9ac_f5a8_4538_ae4b_8c0b56e17cff.slice/crio-5b39e8d0612492fefeff2d8e99b386c0c100c997b38a4c8f55a6c9bb0c0505fa WatchSource:0}: Error finding container 5b39e8d0612492fefeff2d8e99b386c0c100c997b38a4c8f55a6c9bb0c0505fa: Status 404 returned error can't find the container with id 5b39e8d0612492fefeff2d8e99b386c0c100c997b38a4c8f55a6c9bb0c0505fa Jul 27 15:53:52.123073 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:52.122953 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2875ea72-06f8-4c75-b39b-2524b82f6875-metrics-certs\") pod \"network-metrics-daemon-vpk45\" (UID: \"2875ea72-06f8-4c75-b39b-2524b82f6875\") " pod="openshift-multus/network-metrics-daemon-vpk45" Jul 27 15:53:52.123073 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:52.123011 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db554c84-03a7-4127-8c5b-c7c18897237d-original-pull-secret\") pod \"global-pull-secret-syncer-v2tkp\" (UID: \"db554c84-03a7-4127-8c5b-c7c18897237d\") " pod="kube-system/global-pull-secret-syncer-v2tkp" Jul 27 15:53:52.123299 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:52.123123 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 15:53:52.123299 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:52.123129 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 15:53:52.123299 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:52.123179 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db554c84-03a7-4127-8c5b-c7c18897237d-original-pull-secret podName:db554c84-03a7-4127-8c5b-c7c18897237d nodeName:}" failed. No retries permitted until 2026-07-27 15:53:53.12316401 +0000 UTC m=+3.916890272 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db554c84-03a7-4127-8c5b-c7c18897237d-original-pull-secret") pod "global-pull-secret-syncer-v2tkp" (UID: "db554c84-03a7-4127-8c5b-c7c18897237d") : object "kube-system"/"original-pull-secret" not registered Jul 27 15:53:52.123299 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:52.123193 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2875ea72-06f8-4c75-b39b-2524b82f6875-metrics-certs podName:2875ea72-06f8-4c75-b39b-2524b82f6875 nodeName:}" failed. No retries permitted until 2026-07-27 15:53:53.123187189 +0000 UTC m=+3.916913447 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2875ea72-06f8-4c75-b39b-2524b82f6875-metrics-certs") pod "network-metrics-daemon-vpk45" (UID: "2875ea72-06f8-4c75-b39b-2524b82f6875") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 15:53:52.324539 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:52.324491 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsdnn\" (UniqueName: \"kubernetes.io/projected/26984101-b8ab-4b8c-9272-2cc91f0e2ee9-kube-api-access-rsdnn\") pod \"network-check-target-6khtd\" (UID: \"26984101-b8ab-4b8c-9272-2cc91f0e2ee9\") " pod="openshift-network-diagnostics/network-check-target-6khtd" Jul 27 15:53:52.324770 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:52.324727 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 15:53:52.324770 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:52.324765 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 15:53:52.324770 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:52.324779 2561 projected.go:196] Error preparing data for projected volume kube-api-access-rsdnn for pod openshift-network-diagnostics/network-check-target-6khtd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 15:53:52.325040 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:52.324865 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/26984101-b8ab-4b8c-9272-2cc91f0e2ee9-kube-api-access-rsdnn podName:26984101-b8ab-4b8c-9272-2cc91f0e2ee9 nodeName:}" failed. No retries permitted until 2026-07-27 15:53:53.324839675 +0000 UTC m=+4.118565936 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rsdnn" (UniqueName: "kubernetes.io/projected/26984101-b8ab-4b8c-9272-2cc91f0e2ee9-kube-api-access-rsdnn") pod "network-check-target-6khtd" (UID: "26984101-b8ab-4b8c-9272-2cc91f0e2ee9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 15:53:52.555880 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:52.555749 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 15:48:52 +0000 UTC" deadline="2028-04-07 02:56:27.495431452 +0000 UTC" Jul 27 15:53:52.555880 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:52.555829 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14867h2m34.939606691s" Jul 27 15:53:52.631167 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:52.631128 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vpk45" Jul 27 15:53:52.631445 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:52.631294 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vpk45" podUID="2875ea72-06f8-4c75-b39b-2524b82f6875" Jul 27 15:53:52.631787 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:52.631765 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2tkp" Jul 27 15:53:52.631966 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:52.631898 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2tkp" podUID="db554c84-03a7-4127-8c5b-c7c18897237d" Jul 27 15:53:52.648625 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:52.648509 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxd6w" event={"ID":"b43e7b7b-4cf8-4ee9-a131-23c2dd05154e","Type":"ContainerStarted","Data":"d98bb054e102644e18733d21986013989d91e31e6c65b97ebb1ec5797734e594"} Jul 27 15:53:52.657152 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:52.657105 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" event={"ID":"4110ede3-5c49-41c8-90d7-091cbc5def4a","Type":"ContainerStarted","Data":"1a0519d86fa01e84410d0a064fbee470aef3869ae485e0e5f3e96ccdcf32d30a"} Jul 27 15:53:52.660231 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:52.660193 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-29p88" event={"ID":"c363121b-53af-4035-86d4-b535c823d3c4","Type":"ContainerStarted","Data":"3842b6188499f2e4ef3317dbe1be4f6bd1b43471498c5f5b44aea8c2d279f646"} Jul 27 15:53:52.663828 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:52.663792 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tzdrq" event={"ID":"a28e8365-5281-405d-aa55-bc4ff9a8b671","Type":"ContainerStarted","Data":"dd9c54351a8dae7568621594e08a45ca259dbfca68242f65c592784805ea0c2c"} Jul 27 15:53:52.666003 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:52.665971 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7nsnh" event={"ID":"dd45f717-ad83-4aad-ba24-2b77778ff926","Type":"ContainerStarted","Data":"9260554e9ccbd5e4f8620747253510f1a0b855dd8e92ffd21da82f1cd61d626f"} Jul 27 15:53:52.669745 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:52.669693 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-62j4b" event={"ID":"aadbe564-2de9-44b9-b409-b190bc6f4a26","Type":"ContainerStarted","Data":"0f9fc7d40a01ce2ee3558e1cb9c3d9610ea296623be69fef6ee0d2c38e385d14"} Jul 27 15:53:52.673908 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:52.673851 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zf9cg" event={"ID":"8d8db91e-5711-4fa5-af72-baa451e66451","Type":"ContainerStarted","Data":"36cbfad8340bab21def4549f9e033238cba284ebfa84f188e51748f5bc914d68"} Jul 27 15:53:52.677974 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:52.677872 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-4.ec2.internal" event={"ID":"fc7a2b8b8acfc7d700d26229752a314e","Type":"ContainerStarted","Data":"9707a1fc11944757ba879490eb8fcd5364acf456758aed87bf0fd49fa8a86bc5"} Jul 27 15:53:52.682924 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:52.682894 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-t7xdc" event={"ID":"ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff","Type":"ContainerStarted","Data":"5b39e8d0612492fefeff2d8e99b386c0c100c997b38a4c8f55a6c9bb0c0505fa"} Jul 27 15:53:52.688120 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:52.687266 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4l8tg" event={"ID":"7299eae8-57e9-40fa-a73d-6ca4856375de","Type":"ContainerStarted","Data":"7f31314f1f002a0a1dae8bb1a79dd6ffb4b2d02c0213e49eabff8083048be8e3"} Jul 27 15:53:53.131568 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:53.131526 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db554c84-03a7-4127-8c5b-c7c18897237d-original-pull-secret\") pod \"global-pull-secret-syncer-v2tkp\" (UID: \"db554c84-03a7-4127-8c5b-c7c18897237d\") " pod="kube-system/global-pull-secret-syncer-v2tkp" Jul 27 15:53:53.131802 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:53.131626 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2875ea72-06f8-4c75-b39b-2524b82f6875-metrics-certs\") pod \"network-metrics-daemon-vpk45\" (UID: \"2875ea72-06f8-4c75-b39b-2524b82f6875\") " pod="openshift-multus/network-metrics-daemon-vpk45" Jul 27 15:53:53.131802 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:53.131764 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 15:53:53.132040 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:53.131832 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2875ea72-06f8-4c75-b39b-2524b82f6875-metrics-certs podName:2875ea72-06f8-4c75-b39b-2524b82f6875 nodeName:}" failed. No retries permitted until 2026-07-27 15:53:55.131812768 +0000 UTC m=+5.925539029 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2875ea72-06f8-4c75-b39b-2524b82f6875-metrics-certs") pod "network-metrics-daemon-vpk45" (UID: "2875ea72-06f8-4c75-b39b-2524b82f6875") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 15:53:53.132308 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:53.132285 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 15:53:53.132386 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:53.132352 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db554c84-03a7-4127-8c5b-c7c18897237d-original-pull-secret podName:db554c84-03a7-4127-8c5b-c7c18897237d nodeName:}" failed. No retries permitted until 2026-07-27 15:53:55.132332878 +0000 UTC m=+5.926059140 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db554c84-03a7-4127-8c5b-c7c18897237d-original-pull-secret") pod "global-pull-secret-syncer-v2tkp" (UID: "db554c84-03a7-4127-8c5b-c7c18897237d") : object "kube-system"/"original-pull-secret" not registered Jul 27 15:53:53.333896 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:53.333811 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsdnn\" (UniqueName: \"kubernetes.io/projected/26984101-b8ab-4b8c-9272-2cc91f0e2ee9-kube-api-access-rsdnn\") pod \"network-check-target-6khtd\" (UID: \"26984101-b8ab-4b8c-9272-2cc91f0e2ee9\") " pod="openshift-network-diagnostics/network-check-target-6khtd" Jul 27 15:53:53.334156 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:53.334113 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 15:53:53.334156 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:53.334141 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 15:53:53.334156 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:53.334156 2561 projected.go:196] Error preparing data for projected volume kube-api-access-rsdnn for pod openshift-network-diagnostics/network-check-target-6khtd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 15:53:53.334337 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:53.334230 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/26984101-b8ab-4b8c-9272-2cc91f0e2ee9-kube-api-access-rsdnn podName:26984101-b8ab-4b8c-9272-2cc91f0e2ee9 nodeName:}" failed. No retries permitted until 2026-07-27 15:53:55.334209495 +0000 UTC m=+6.127935757 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rsdnn" (UniqueName: "kubernetes.io/projected/26984101-b8ab-4b8c-9272-2cc91f0e2ee9-kube-api-access-rsdnn") pod "network-check-target-6khtd" (UID: "26984101-b8ab-4b8c-9272-2cc91f0e2ee9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 15:53:53.556363 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:53.556297 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 15:48:52 +0000 UTC" deadline="2028-02-29 07:23:34.365961882 +0000 UTC" Jul 27 15:53:53.556363 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:53.556344 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13959h29m40.809623054s" Jul 27 15:53:53.633633 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:53.633596 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6khtd" Jul 27 15:53:53.633846 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:53.633739 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6khtd" podUID="26984101-b8ab-4b8c-9272-2cc91f0e2ee9" Jul 27 15:53:54.630663 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:54.630627 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2tkp" Jul 27 15:53:54.630663 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:54.630653 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vpk45" Jul 27 15:53:54.631311 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:54.630779 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vpk45" podUID="2875ea72-06f8-4c75-b39b-2524b82f6875" Jul 27 15:53:54.631311 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:54.631028 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2tkp" podUID="db554c84-03a7-4127-8c5b-c7c18897237d" Jul 27 15:53:55.153352 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:55.152510 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db554c84-03a7-4127-8c5b-c7c18897237d-original-pull-secret\") pod \"global-pull-secret-syncer-v2tkp\" (UID: \"db554c84-03a7-4127-8c5b-c7c18897237d\") " pod="kube-system/global-pull-secret-syncer-v2tkp" Jul 27 15:53:55.153352 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:55.152625 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2875ea72-06f8-4c75-b39b-2524b82f6875-metrics-certs\") pod \"network-metrics-daemon-vpk45\" (UID: \"2875ea72-06f8-4c75-b39b-2524b82f6875\") " pod="openshift-multus/network-metrics-daemon-vpk45" Jul 27 15:53:55.153352 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:55.152764 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 15:53:55.153352 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:55.152830 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2875ea72-06f8-4c75-b39b-2524b82f6875-metrics-certs podName:2875ea72-06f8-4c75-b39b-2524b82f6875 nodeName:}" failed. No retries permitted until 2026-07-27 15:53:59.152810339 +0000 UTC m=+9.946536600 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2875ea72-06f8-4c75-b39b-2524b82f6875-metrics-certs") pod "network-metrics-daemon-vpk45" (UID: "2875ea72-06f8-4c75-b39b-2524b82f6875") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 15:53:55.153352 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:55.152920 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 15:53:55.153352 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:55.152959 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db554c84-03a7-4127-8c5b-c7c18897237d-original-pull-secret podName:db554c84-03a7-4127-8c5b-c7c18897237d nodeName:}" failed. No retries permitted until 2026-07-27 15:53:59.152946183 +0000 UTC m=+9.946672449 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db554c84-03a7-4127-8c5b-c7c18897237d-original-pull-secret") pod "global-pull-secret-syncer-v2tkp" (UID: "db554c84-03a7-4127-8c5b-c7c18897237d") : object "kube-system"/"original-pull-secret" not registered Jul 27 15:53:55.355033 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:55.354309 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsdnn\" (UniqueName: \"kubernetes.io/projected/26984101-b8ab-4b8c-9272-2cc91f0e2ee9-kube-api-access-rsdnn\") pod \"network-check-target-6khtd\" (UID: \"26984101-b8ab-4b8c-9272-2cc91f0e2ee9\") " pod="openshift-network-diagnostics/network-check-target-6khtd" Jul 27 15:53:55.355033 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:55.354513 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 15:53:55.355033 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:55.354534 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 15:53:55.355033 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:55.354549 2561 projected.go:196] Error preparing data for projected volume kube-api-access-rsdnn for pod openshift-network-diagnostics/network-check-target-6khtd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 15:53:55.355033 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:55.354625 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/26984101-b8ab-4b8c-9272-2cc91f0e2ee9-kube-api-access-rsdnn podName:26984101-b8ab-4b8c-9272-2cc91f0e2ee9 nodeName:}" failed. No retries permitted until 2026-07-27 15:53:59.354594519 +0000 UTC m=+10.148320800 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rsdnn" (UniqueName: "kubernetes.io/projected/26984101-b8ab-4b8c-9272-2cc91f0e2ee9-kube-api-access-rsdnn") pod "network-check-target-6khtd" (UID: "26984101-b8ab-4b8c-9272-2cc91f0e2ee9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 15:53:55.631424 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:55.630779 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6khtd" Jul 27 15:53:55.631424 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:55.630957 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6khtd" podUID="26984101-b8ab-4b8c-9272-2cc91f0e2ee9" Jul 27 15:53:56.630414 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:56.630271 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vpk45" Jul 27 15:53:56.630414 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:56.630273 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2tkp" Jul 27 15:53:56.631410 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:56.630769 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vpk45" podUID="2875ea72-06f8-4c75-b39b-2524b82f6875" Jul 27 15:53:56.631410 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:56.630940 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2tkp" podUID="db554c84-03a7-4127-8c5b-c7c18897237d" Jul 27 15:53:57.630776 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:57.630692 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6khtd" Jul 27 15:53:57.631110 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:57.630852 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6khtd" podUID="26984101-b8ab-4b8c-9272-2cc91f0e2ee9" Jul 27 15:53:58.631245 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:58.631199 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2tkp" Jul 27 15:53:58.631757 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:58.631199 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vpk45" Jul 27 15:53:58.631757 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:58.631365 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2tkp" podUID="db554c84-03a7-4127-8c5b-c7c18897237d" Jul 27 15:53:58.631757 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:58.631485 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vpk45" podUID="2875ea72-06f8-4c75-b39b-2524b82f6875" Jul 27 15:53:59.189506 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:59.189233 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db554c84-03a7-4127-8c5b-c7c18897237d-original-pull-secret\") pod \"global-pull-secret-syncer-v2tkp\" (UID: \"db554c84-03a7-4127-8c5b-c7c18897237d\") " pod="kube-system/global-pull-secret-syncer-v2tkp" Jul 27 15:53:59.189506 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:59.189343 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2875ea72-06f8-4c75-b39b-2524b82f6875-metrics-certs\") pod \"network-metrics-daemon-vpk45\" (UID: \"2875ea72-06f8-4c75-b39b-2524b82f6875\") " pod="openshift-multus/network-metrics-daemon-vpk45" Jul 27 15:53:59.189506 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:59.189403 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 15:53:59.189506 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:59.189443 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 15:53:59.189506 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:59.189495 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db554c84-03a7-4127-8c5b-c7c18897237d-original-pull-secret podName:db554c84-03a7-4127-8c5b-c7c18897237d nodeName:}" failed. No retries permitted until 2026-07-27 15:54:07.189473684 +0000 UTC m=+17.983199986 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db554c84-03a7-4127-8c5b-c7c18897237d-original-pull-secret") pod "global-pull-secret-syncer-v2tkp" (UID: "db554c84-03a7-4127-8c5b-c7c18897237d") : object "kube-system"/"original-pull-secret" not registered Jul 27 15:53:59.189506 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:59.189517 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2875ea72-06f8-4c75-b39b-2524b82f6875-metrics-certs podName:2875ea72-06f8-4c75-b39b-2524b82f6875 nodeName:}" failed. No retries permitted until 2026-07-27 15:54:07.189506942 +0000 UTC m=+17.983233216 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2875ea72-06f8-4c75-b39b-2524b82f6875-metrics-certs") pod "network-metrics-daemon-vpk45" (UID: "2875ea72-06f8-4c75-b39b-2524b82f6875") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 15:53:59.390943 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:59.390901 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsdnn\" (UniqueName: \"kubernetes.io/projected/26984101-b8ab-4b8c-9272-2cc91f0e2ee9-kube-api-access-rsdnn\") pod \"network-check-target-6khtd\" (UID: \"26984101-b8ab-4b8c-9272-2cc91f0e2ee9\") " pod="openshift-network-diagnostics/network-check-target-6khtd" Jul 27 15:53:59.391214 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:59.391134 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 15:53:59.391214 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:59.391167 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 15:53:59.391214 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:59.391183 2561 projected.go:196] Error preparing data for projected volume kube-api-access-rsdnn for pod openshift-network-diagnostics/network-check-target-6khtd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 15:53:59.391410 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:59.391294 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/26984101-b8ab-4b8c-9272-2cc91f0e2ee9-kube-api-access-rsdnn podName:26984101-b8ab-4b8c-9272-2cc91f0e2ee9 nodeName:}" failed. No retries permitted until 2026-07-27 15:54:07.391269641 +0000 UTC m=+18.184995923 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rsdnn" (UniqueName: "kubernetes.io/projected/26984101-b8ab-4b8c-9272-2cc91f0e2ee9-kube-api-access-rsdnn") pod "network-check-target-6khtd" (UID: "26984101-b8ab-4b8c-9272-2cc91f0e2ee9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 15:53:59.634928 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:53:59.634772 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6khtd" Jul 27 15:53:59.635424 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:53:59.634919 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6khtd" podUID="26984101-b8ab-4b8c-9272-2cc91f0e2ee9" Jul 27 15:54:00.630812 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:00.630769 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vpk45" Jul 27 15:54:00.630997 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:00.630769 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2tkp" Jul 27 15:54:00.630997 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:00.630938 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vpk45" podUID="2875ea72-06f8-4c75-b39b-2524b82f6875" Jul 27 15:54:00.631085 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:00.631047 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2tkp" podUID="db554c84-03a7-4127-8c5b-c7c18897237d" Jul 27 15:54:01.631256 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:01.631219 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6khtd" Jul 27 15:54:01.631738 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:01.631406 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6khtd" podUID="26984101-b8ab-4b8c-9272-2cc91f0e2ee9" Jul 27 15:54:02.630732 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:02.630696 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vpk45" Jul 27 15:54:02.630933 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:02.630844 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vpk45" podUID="2875ea72-06f8-4c75-b39b-2524b82f6875" Jul 27 15:54:02.630933 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:02.630888 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2tkp" Jul 27 15:54:02.631050 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:02.630992 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2tkp" podUID="db554c84-03a7-4127-8c5b-c7c18897237d" Jul 27 15:54:03.630333 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:03.630294 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6khtd" Jul 27 15:54:03.630792 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:03.630434 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6khtd" podUID="26984101-b8ab-4b8c-9272-2cc91f0e2ee9" Jul 27 15:54:04.631013 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:04.630809 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vpk45" Jul 27 15:54:04.631013 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:04.630853 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2tkp" Jul 27 15:54:04.631013 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:04.630963 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vpk45" podUID="2875ea72-06f8-4c75-b39b-2524b82f6875" Jul 27 15:54:04.631544 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:04.631115 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2tkp" podUID="db554c84-03a7-4127-8c5b-c7c18897237d" Jul 27 15:54:05.630715 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:05.630672 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6khtd" Jul 27 15:54:05.630907 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:05.630828 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6khtd" podUID="26984101-b8ab-4b8c-9272-2cc91f0e2ee9" Jul 27 15:54:06.630372 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:06.630333 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vpk45" Jul 27 15:54:06.630849 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:06.630389 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2tkp" Jul 27 15:54:06.630849 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:06.630475 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vpk45" podUID="2875ea72-06f8-4c75-b39b-2524b82f6875" Jul 27 15:54:06.630849 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:06.630608 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2tkp" podUID="db554c84-03a7-4127-8c5b-c7c18897237d" Jul 27 15:54:07.253409 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:07.253370 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2875ea72-06f8-4c75-b39b-2524b82f6875-metrics-certs\") pod \"network-metrics-daemon-vpk45\" (UID: \"2875ea72-06f8-4c75-b39b-2524b82f6875\") " pod="openshift-multus/network-metrics-daemon-vpk45" Jul 27 15:54:07.253623 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:07.253429 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db554c84-03a7-4127-8c5b-c7c18897237d-original-pull-secret\") pod \"global-pull-secret-syncer-v2tkp\" (UID: \"db554c84-03a7-4127-8c5b-c7c18897237d\") " pod="kube-system/global-pull-secret-syncer-v2tkp" Jul 27 15:54:07.253623 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:07.253537 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 15:54:07.253623 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:07.253598 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db554c84-03a7-4127-8c5b-c7c18897237d-original-pull-secret podName:db554c84-03a7-4127-8c5b-c7c18897237d nodeName:}" failed. No retries permitted until 2026-07-27 15:54:23.253584839 +0000 UTC m=+34.047311095 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db554c84-03a7-4127-8c5b-c7c18897237d-original-pull-secret") pod "global-pull-secret-syncer-v2tkp" (UID: "db554c84-03a7-4127-8c5b-c7c18897237d") : object "kube-system"/"original-pull-secret" not registered Jul 27 15:54:07.253623 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:07.253537 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 15:54:07.253784 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:07.253664 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2875ea72-06f8-4c75-b39b-2524b82f6875-metrics-certs podName:2875ea72-06f8-4c75-b39b-2524b82f6875 nodeName:}" failed. No retries permitted until 2026-07-27 15:54:23.253651194 +0000 UTC m=+34.047377456 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2875ea72-06f8-4c75-b39b-2524b82f6875-metrics-certs") pod "network-metrics-daemon-vpk45" (UID: "2875ea72-06f8-4c75-b39b-2524b82f6875") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 15:54:07.454502 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:07.454457 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsdnn\" (UniqueName: \"kubernetes.io/projected/26984101-b8ab-4b8c-9272-2cc91f0e2ee9-kube-api-access-rsdnn\") pod \"network-check-target-6khtd\" (UID: \"26984101-b8ab-4b8c-9272-2cc91f0e2ee9\") " pod="openshift-network-diagnostics/network-check-target-6khtd" Jul 27 15:54:07.454696 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:07.454661 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 15:54:07.454696 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:07.454691 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 15:54:07.454792 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:07.454705 2561 projected.go:196] Error preparing data for projected volume kube-api-access-rsdnn for pod openshift-network-diagnostics/network-check-target-6khtd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 15:54:07.454792 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:07.454775 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/26984101-b8ab-4b8c-9272-2cc91f0e2ee9-kube-api-access-rsdnn podName:26984101-b8ab-4b8c-9272-2cc91f0e2ee9 nodeName:}" failed. No retries permitted until 2026-07-27 15:54:23.454754314 +0000 UTC m=+34.248480575 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rsdnn" (UniqueName: "kubernetes.io/projected/26984101-b8ab-4b8c-9272-2cc91f0e2ee9-kube-api-access-rsdnn") pod "network-check-target-6khtd" (UID: "26984101-b8ab-4b8c-9272-2cc91f0e2ee9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 15:54:07.631356 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:07.631271 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6khtd" Jul 27 15:54:07.631793 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:07.631401 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6khtd" podUID="26984101-b8ab-4b8c-9272-2cc91f0e2ee9" Jul 27 15:54:08.630393 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:08.630360 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2tkp" Jul 27 15:54:08.630568 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:08.630361 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vpk45" Jul 27 15:54:08.630568 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:08.630497 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2tkp" podUID="db554c84-03a7-4127-8c5b-c7c18897237d" Jul 27 15:54:08.630676 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:08.630576 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vpk45" podUID="2875ea72-06f8-4c75-b39b-2524b82f6875" Jul 27 15:54:09.631191 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:09.631150 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6khtd" Jul 27 15:54:09.631653 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:09.631260 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6khtd" podUID="26984101-b8ab-4b8c-9272-2cc91f0e2ee9" Jul 27 15:54:10.630497 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:10.630456 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vpk45" Jul 27 15:54:10.630696 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:10.630587 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vpk45" podUID="2875ea72-06f8-4c75-b39b-2524b82f6875" Jul 27 15:54:10.630696 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:10.630642 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2tkp" Jul 27 15:54:10.630822 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:10.630754 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2tkp" podUID="db554c84-03a7-4127-8c5b-c7c18897237d" Jul 27 15:54:11.630443 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:11.630394 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6khtd" Jul 27 15:54:11.630875 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:11.630545 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6khtd" podUID="26984101-b8ab-4b8c-9272-2cc91f0e2ee9" Jul 27 15:54:12.630523 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:12.630216 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vpk45" Jul 27 15:54:12.630523 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:12.630309 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2tkp" Jul 27 15:54:12.630957 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:12.630561 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vpk45" podUID="2875ea72-06f8-4c75-b39b-2524b82f6875" Jul 27 15:54:12.630957 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:12.630630 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2tkp" podUID="db554c84-03a7-4127-8c5b-c7c18897237d" Jul 27 15:54:12.747375 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:12.747280 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7nsnh" event={"ID":"dd45f717-ad83-4aad-ba24-2b77778ff926","Type":"ContainerStarted","Data":"84a07ebbba23c8ea587451dd4059b8a7f7d6d46f9a1040732e36fff81f884a50"} Jul 27 15:54:12.753404 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:12.753367 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-4.ec2.internal" event={"ID":"fc7a2b8b8acfc7d700d26229752a314e","Type":"ContainerStarted","Data":"f9e8eb97ed14cacea28aafb947a3a16ab8bdd82040f98ab2aa110c4ca50a32e2"} Jul 27 15:54:12.766148 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:12.766013 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-t7xdc" event={"ID":"ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff","Type":"ContainerStarted","Data":"dc34f412f6d2d1d4acc10a737d864bc1e202956cc3a0b47a21ec67ed3266ad9f"} Jul 27 15:54:12.806469 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:12.805682 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-7nsnh" podStartSLOduration=2.044812075 podStartE2EDuration="22.805661873s" totalImagesPullingTime="20.760849798s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 15:53:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:54:12.769007559 +0000 UTC m=+23.562733839" watchObservedRunningTime="2026-07-27 15:54:12.805661873 +0000 UTC m=+23.599388152" Jul 27 15:54:12.835407 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:12.835173 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-4.ec2.internal" podStartSLOduration=21.835147257 podStartE2EDuration="21.835147257s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 15:53:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:54:12.834284563 +0000 UTC m=+23.628010843" watchObservedRunningTime="2026-07-27 15:54:12.835147257 +0000 UTC m=+23.628873546" Jul 27 15:54:12.835611 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:12.835575 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-t7xdc" podStartSLOduration=2.158458982 podStartE2EDuration="22.835562212s" totalImagesPullingTime="20.67710323s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 15:53:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:54:12.806846756 +0000 UTC m=+23.600573035" watchObservedRunningTime="2026-07-27 15:54:12.835562212 +0000 UTC m=+23.629288516" Jul 27 15:54:13.631129 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:13.631097 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6khtd" Jul 27 15:54:13.631831 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:13.631201 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6khtd" podUID="26984101-b8ab-4b8c-9272-2cc91f0e2ee9" Jul 27 15:54:13.769519 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:13.769484 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxd6w" event={"ID":"b43e7b7b-4cf8-4ee9-a131-23c2dd05154e","Type":"ContainerStarted","Data":"9413f071afb96ecfaad55df624023fd050cdc23c8607ad4fbb4ca59bbcd1020a"} Jul 27 15:54:13.772448 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:13.772422 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" event={"ID":"4110ede3-5c49-41c8-90d7-091cbc5def4a","Type":"ContainerStarted","Data":"1c4bac651bc8766b0ac1f82e72fef7d0306ece72cb45be71408f151dc13b615f"} Jul 27 15:54:13.772590 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:13.772500 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" event={"ID":"4110ede3-5c49-41c8-90d7-091cbc5def4a","Type":"ContainerStarted","Data":"86a885a049b35d8592802f272f2769350a84e08dd8a26990bc7afc1dea9f7e1b"} Jul 27 15:54:13.772590 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:13.772551 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" event={"ID":"4110ede3-5c49-41c8-90d7-091cbc5def4a","Type":"ContainerStarted","Data":"025e152d33ee85286bc30c18166561ed09edf8f39aff104bd9a94c9b567142c6"} Jul 27 15:54:13.772677 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:13.772591 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" event={"ID":"4110ede3-5c49-41c8-90d7-091cbc5def4a","Type":"ContainerStarted","Data":"1b635951bf51d90ee99c6985e26a8ca3a6cd611b264add5d95efbdb05c08bc99"} Jul 27 15:54:13.772677 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:13.772656 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" event={"ID":"4110ede3-5c49-41c8-90d7-091cbc5def4a","Type":"ContainerStarted","Data":"99a46e59d424b4fbfda1e847ba8413c7b7380adc356e745a46aecf021cadaa6f"} Jul 27 15:54:13.772748 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:13.772692 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" event={"ID":"4110ede3-5c49-41c8-90d7-091cbc5def4a","Type":"ContainerStarted","Data":"6ef04e362fd9633f68646141411fac1b6cbfd8b2a7210d2315ab345b6598fcfd"} Jul 27 15:54:13.773835 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:13.773795 2561 generic.go:356] "Generic (PLEG): container finished" podID="a28e8365-5281-405d-aa55-bc4ff9a8b671" containerID="23c6e49ed7e60745a95808d699b842a5e95d954148a3f51d72819cb2a6ecc7fd" exitCode=0 Jul 27 15:54:13.773953 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:13.773878 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tzdrq" event={"ID":"a28e8365-5281-405d-aa55-bc4ff9a8b671","Type":"ContainerDied","Data":"23c6e49ed7e60745a95808d699b842a5e95d954148a3f51d72819cb2a6ecc7fd"} Jul 27 15:54:13.775501 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:13.775313 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-62j4b" event={"ID":"aadbe564-2de9-44b9-b409-b190bc6f4a26","Type":"ContainerStarted","Data":"26103464d3385d002b8c6f2e97fe5ca9a8b504487342a412432cd648e42688cf"} Jul 27 15:54:13.776895 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:13.776868 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zf9cg" event={"ID":"8d8db91e-5711-4fa5-af72-baa451e66451","Type":"ContainerStarted","Data":"fcd30a0cc445276587e320b6a73770b57982143e27a77284a48b30a60c0265ce"} Jul 27 15:54:13.778431 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:13.778412 2561 generic.go:356] "Generic (PLEG): container finished" podID="94064bde37d1f180cd8431f305ec203f" containerID="087c0c39cdd943f38706811d13d95bdc3c808612dcfe0029eef231b8b337a42c" exitCode=0 Jul 27 15:54:13.778542 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:13.778479 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-4.ec2.internal" event={"ID":"94064bde37d1f180cd8431f305ec203f","Type":"ContainerDied","Data":"087c0c39cdd943f38706811d13d95bdc3c808612dcfe0029eef231b8b337a42c"} Jul 27 15:54:13.779946 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:13.779926 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4l8tg" event={"ID":"7299eae8-57e9-40fa-a73d-6ca4856375de","Type":"ContainerStarted","Data":"948b05adc5b576fa41a5f5dcc67113ebf1241140bc6de56a33b14a11d20d75a1"} Jul 27 15:54:13.821692 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:13.821635 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-zf9cg" podStartSLOduration=7.254865228 podStartE2EDuration="23.821615313s" totalImagesPullingTime="16.566750085s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 15:53:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:54:13.821056561 +0000 UTC m=+24.614782841" watchObservedRunningTime="2026-07-27 15:54:13.821615313 +0000 UTC m=+24.615341595" Jul 27 15:54:13.834373 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:13.834319 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-62j4b" podStartSLOduration=3.121299168 podStartE2EDuration="23.834297199s" totalImagesPullingTime="20.712998031s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 15:53:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:54:13.834196217 +0000 UTC m=+24.627922534" watchObservedRunningTime="2026-07-27 15:54:13.834297199 +0000 UTC m=+24.628023479" Jul 27 15:54:13.847825 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:13.847591 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4l8tg" podStartSLOduration=7.339650494 podStartE2EDuration="23.847575594s" totalImagesPullingTime="16.5079251s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:53:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:54:13.847302004 +0000 UTC m=+24.641028283" watchObservedRunningTime="2026-07-27 15:54:13.847575594 +0000 UTC m=+24.641301872" Jul 27 15:54:14.630994 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:14.630954 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2tkp" Jul 27 15:54:14.631328 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:14.630954 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vpk45" Jul 27 15:54:14.631328 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:14.631083 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2tkp" podUID="db554c84-03a7-4127-8c5b-c7c18897237d" Jul 27 15:54:14.631328 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:14.631214 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vpk45" podUID="2875ea72-06f8-4c75-b39b-2524b82f6875" Jul 27 15:54:14.784350 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:14.784309 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-29p88" event={"ID":"c363121b-53af-4035-86d4-b535c823d3c4","Type":"ContainerStarted","Data":"b3d55089145f344efdf07d1f6a96a699605471b5fc8b708c4db32a3050650a62"} Jul 27 15:54:14.786589 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:14.786528 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-4.ec2.internal" event={"ID":"94064bde37d1f180cd8431f305ec203f","Type":"ContainerStarted","Data":"fe7e57ddb7d0318cb16faad0614b734e85385a295dd6aaf4cf19c6dc60ed3f80"} Jul 27 15:54:14.798980 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:14.798926 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-29p88" podStartSLOduration=4.110162009 podStartE2EDuration="24.798908215s" totalImagesPullingTime="20.688746206s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 15:53:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:54:14.798685511 +0000 UTC m=+25.592411793" watchObservedRunningTime="2026-07-27 15:54:14.798908215 +0000 UTC m=+25.592634507" Jul 27 15:54:14.811538 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:14.811493 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-4.ec2.internal" podStartSLOduration=23.81147523 podStartE2EDuration="23.81147523s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 15:53:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:54:14.811214705 +0000 UTC m=+25.604940994" watchObservedRunningTime="2026-07-27 15:54:14.81147523 +0000 UTC m=+25.605201509" Jul 27 15:54:14.836148 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:14.836121 2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 27 15:54:15.575377 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:15.575249 2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-27T15:54:14.836142796Z","UUID":"ab67b87e-32a3-40f7-b86d-93b4f0d5795b","Handler":null,"Name":"","Endpoint":""} Jul 27 15:54:15.577170 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:15.577144 2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 27 15:54:15.577170 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:15.577182 2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 27 15:54:15.630304 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:15.630260 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6khtd" Jul 27 15:54:15.630480 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:15.630414 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6khtd" podUID="26984101-b8ab-4b8c-9272-2cc91f0e2ee9" Jul 27 15:54:15.791680 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:15.791591 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxd6w" event={"ID":"b43e7b7b-4cf8-4ee9-a131-23c2dd05154e","Type":"ContainerStarted","Data":"75b247fd295c607b0278a5d8d1ae15fb943dac7239b7f23507159099c955e6e0"} Jul 27 15:54:15.796368 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:15.796326 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" event={"ID":"4110ede3-5c49-41c8-90d7-091cbc5def4a","Type":"ContainerStarted","Data":"577c3a5a86762a1f302290a81f946b0b0e5746c0aa9b131eac5b8dadd3cb2a61"} Jul 27 15:54:16.630754 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:16.630671 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vpk45" Jul 27 15:54:16.630754 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:16.630716 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2tkp" Jul 27 15:54:16.631028 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:16.630825 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vpk45" podUID="2875ea72-06f8-4c75-b39b-2524b82f6875" Jul 27 15:54:16.631028 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:16.630905 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2tkp" podUID="db554c84-03a7-4127-8c5b-c7c18897237d" Jul 27 15:54:16.801720 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:16.801679 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxd6w" event={"ID":"b43e7b7b-4cf8-4ee9-a131-23c2dd05154e","Type":"ContainerStarted","Data":"941cb21d07eac8661b542535adbee85de5bb41c8732cda531329800eacc70b2d"} Jul 27 15:54:16.818486 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:16.818421 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxd6w" podStartSLOduration=3.054546139 podStartE2EDuration="26.818401086s" totalImagesPullingTime="23.763854947s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 15:53:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:54:16.817887662 +0000 UTC m=+27.611613980" watchObservedRunningTime="2026-07-27 15:54:16.818401086 +0000 UTC m=+27.612127366" Jul 27 15:54:17.630912 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:17.630878 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6khtd" Jul 27 15:54:17.631106 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:17.631014 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6khtd" podUID="26984101-b8ab-4b8c-9272-2cc91f0e2ee9" Jul 27 15:54:18.023989 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:18.023771 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4l8tg" Jul 27 15:54:18.024576 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:18.024558 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4l8tg" Jul 27 15:54:18.630648 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:18.630607 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2tkp" Jul 27 15:54:18.630891 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:18.630650 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vpk45" Jul 27 15:54:18.630891 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:18.630741 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2tkp" podUID="db554c84-03a7-4127-8c5b-c7c18897237d" Jul 27 15:54:18.630891 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:18.630871 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vpk45" podUID="2875ea72-06f8-4c75-b39b-2524b82f6875" Jul 27 15:54:18.809412 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:18.809373 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" event={"ID":"4110ede3-5c49-41c8-90d7-091cbc5def4a","Type":"ContainerStarted","Data":"4b9a07876e1e8510661cb04dfe89943b0a01d4619701af0c976252a94cbc4c2f"} Jul 27 15:54:18.809622 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:18.809606 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:54:18.811286 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:18.811251 2561 generic.go:356] "Generic (PLEG): container finished" podID="a28e8365-5281-405d-aa55-bc4ff9a8b671" containerID="03abc0bfc1cba444a56f0b56a5b580e59759cbe70c9c5145c9677e76f7423f00" exitCode=0 Jul 27 15:54:18.811409 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:18.811338 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tzdrq" event={"ID":"a28e8365-5281-405d-aa55-bc4ff9a8b671","Type":"ContainerDied","Data":"03abc0bfc1cba444a56f0b56a5b580e59759cbe70c9c5145c9677e76f7423f00"} Jul 27 15:54:18.811619 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:18.811603 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4l8tg" Jul 27 15:54:18.812542 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:18.812156 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4l8tg" Jul 27 15:54:18.825255 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:18.825231 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:54:18.834111 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:18.834067 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" podStartSLOduration=8.078005591 podStartE2EDuration="28.834053135s" totalImagesPullingTime="20.756047544s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 15:53:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:54:18.833960137 +0000 UTC m=+29.627686436" watchObservedRunningTime="2026-07-27 15:54:18.834053135 +0000 UTC m=+29.627779416" Jul 27 15:54:19.632055 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:19.632026 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6khtd" Jul 27 15:54:19.632717 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:19.632117 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6khtd" podUID="26984101-b8ab-4b8c-9272-2cc91f0e2ee9" Jul 27 15:54:19.793229 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:19.793179 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vpk45"] Jul 27 15:54:19.793412 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:19.793334 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vpk45" Jul 27 15:54:19.793479 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:19.793459 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vpk45" podUID="2875ea72-06f8-4c75-b39b-2524b82f6875" Jul 27 15:54:19.793967 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:19.793942 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-v2tkp"] Jul 27 15:54:19.794051 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:19.794038 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2tkp" Jul 27 15:54:19.794132 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:19.794116 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2tkp" podUID="db554c84-03a7-4127-8c5b-c7c18897237d" Jul 27 15:54:19.804316 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:19.804282 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6khtd"] Jul 27 15:54:19.813771 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:19.813729 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6khtd" Jul 27 15:54:19.814240 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:19.814203 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6khtd" podUID="26984101-b8ab-4b8c-9272-2cc91f0e2ee9" Jul 27 15:54:19.814507 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:19.814485 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:54:19.814590 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:19.814566 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:54:19.831194 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:19.831164 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:54:21.630346 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:21.630309 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vpk45" Jul 27 15:54:21.630824 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:21.630365 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6khtd" Jul 27 15:54:21.630824 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:21.630309 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2tkp" Jul 27 15:54:21.630824 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:21.630457 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vpk45" podUID="2875ea72-06f8-4c75-b39b-2524b82f6875" Jul 27 15:54:21.630824 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:21.630514 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2tkp" podUID="db554c84-03a7-4127-8c5b-c7c18897237d" Jul 27 15:54:21.630824 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:21.630605 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6khtd" podUID="26984101-b8ab-4b8c-9272-2cc91f0e2ee9" Jul 27 15:54:21.821224 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:21.821008 2561 generic.go:356] "Generic (PLEG): container finished" podID="a28e8365-5281-405d-aa55-bc4ff9a8b671" containerID="19e287f61ce33b03f1d9d968ff549ba44343c9f6354610f66ba2bbb3ce45d854" exitCode=0 Jul 27 15:54:21.821402 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:21.821068 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tzdrq" event={"ID":"a28e8365-5281-405d-aa55-bc4ff9a8b671","Type":"ContainerDied","Data":"19e287f61ce33b03f1d9d968ff549ba44343c9f6354610f66ba2bbb3ce45d854"} Jul 27 15:54:23.268100 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:23.268074 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2875ea72-06f8-4c75-b39b-2524b82f6875-metrics-certs\") pod \"network-metrics-daemon-vpk45\" (UID: \"2875ea72-06f8-4c75-b39b-2524b82f6875\") " pod="openshift-multus/network-metrics-daemon-vpk45" Jul 27 15:54:23.268490 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:23.268110 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db554c84-03a7-4127-8c5b-c7c18897237d-original-pull-secret\") pod \"global-pull-secret-syncer-v2tkp\" (UID: \"db554c84-03a7-4127-8c5b-c7c18897237d\") " pod="kube-system/global-pull-secret-syncer-v2tkp" Jul 27 15:54:23.268490 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:23.268192 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 15:54:23.268490 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:23.268195 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 15:54:23.268490 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:23.268238 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db554c84-03a7-4127-8c5b-c7c18897237d-original-pull-secret podName:db554c84-03a7-4127-8c5b-c7c18897237d nodeName:}" failed. No retries permitted until 2026-07-27 15:54:55.268225255 +0000 UTC m=+66.061951512 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db554c84-03a7-4127-8c5b-c7c18897237d-original-pull-secret") pod "global-pull-secret-syncer-v2tkp" (UID: "db554c84-03a7-4127-8c5b-c7c18897237d") : object "kube-system"/"original-pull-secret" not registered Jul 27 15:54:23.268490 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:23.268252 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2875ea72-06f8-4c75-b39b-2524b82f6875-metrics-certs podName:2875ea72-06f8-4c75-b39b-2524b82f6875 nodeName:}" failed. No retries permitted until 2026-07-27 15:54:55.268245428 +0000 UTC m=+66.061971685 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2875ea72-06f8-4c75-b39b-2524b82f6875-metrics-certs") pod "network-metrics-daemon-vpk45" (UID: "2875ea72-06f8-4c75-b39b-2524b82f6875") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 15:54:23.469358 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:23.469324 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsdnn\" (UniqueName: \"kubernetes.io/projected/26984101-b8ab-4b8c-9272-2cc91f0e2ee9-kube-api-access-rsdnn\") pod \"network-check-target-6khtd\" (UID: \"26984101-b8ab-4b8c-9272-2cc91f0e2ee9\") " pod="openshift-network-diagnostics/network-check-target-6khtd" Jul 27 15:54:23.469549 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:23.469476 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 15:54:23.469549 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:23.469501 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 15:54:23.469549 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:23.469511 2561 projected.go:196] Error preparing data for projected volume kube-api-access-rsdnn for pod openshift-network-diagnostics/network-check-target-6khtd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 15:54:23.469671 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:23.469572 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/26984101-b8ab-4b8c-9272-2cc91f0e2ee9-kube-api-access-rsdnn podName:26984101-b8ab-4b8c-9272-2cc91f0e2ee9 nodeName:}" failed. No retries permitted until 2026-07-27 15:54:55.469553119 +0000 UTC m=+66.263279378 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rsdnn" (UniqueName: "kubernetes.io/projected/26984101-b8ab-4b8c-9272-2cc91f0e2ee9-kube-api-access-rsdnn") pod "network-check-target-6khtd" (UID: "26984101-b8ab-4b8c-9272-2cc91f0e2ee9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 15:54:23.630683 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:23.630602 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2tkp" Jul 27 15:54:23.630871 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:23.630601 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vpk45" Jul 27 15:54:23.630871 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:23.630707 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2tkp" podUID="db554c84-03a7-4127-8c5b-c7c18897237d" Jul 27 15:54:23.630871 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:23.630602 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6khtd" Jul 27 15:54:23.630999 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:23.630901 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6khtd" podUID="26984101-b8ab-4b8c-9272-2cc91f0e2ee9" Jul 27 15:54:23.630999 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:23.630829 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vpk45" podUID="2875ea72-06f8-4c75-b39b-2524b82f6875" Jul 27 15:54:24.831003 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:24.830968 2561 generic.go:356] "Generic (PLEG): container finished" podID="a28e8365-5281-405d-aa55-bc4ff9a8b671" containerID="b3a8b4a0b1ffa74b7a9410c1103c4b89c61f8c9c366705075b321c819359e0fb" exitCode=0 Jul 27 15:54:24.831373 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:24.831034 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tzdrq" event={"ID":"a28e8365-5281-405d-aa55-bc4ff9a8b671","Type":"ContainerDied","Data":"b3a8b4a0b1ffa74b7a9410c1103c4b89c61f8c9c366705075b321c819359e0fb"} Jul 27 15:54:25.630564 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:25.630504 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2tkp" Jul 27 15:54:25.630564 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:25.630565 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vpk45" Jul 27 15:54:25.630858 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:25.630504 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6khtd" Jul 27 15:54:25.630858 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:25.630636 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2tkp" podUID="db554c84-03a7-4127-8c5b-c7c18897237d" Jul 27 15:54:25.630858 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:25.630738 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6khtd" podUID="26984101-b8ab-4b8c-9272-2cc91f0e2ee9" Jul 27 15:54:25.630858 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:25.630829 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vpk45" podUID="2875ea72-06f8-4c75-b39b-2524b82f6875" Jul 27 15:54:26.518139 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:26.518057 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-4.ec2.internal" event="NodeReady" Jul 27 15:54:26.518577 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:26.518228 2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 27 15:54:26.600952 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:26.600782 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-z6kjm"] Jul 27 15:54:26.604704 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:26.604669 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-r6vrq"] Jul 27 15:54:26.604867 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:26.604820 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z6kjm" Jul 27 15:54:26.607615 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:26.607388 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-grq9c\"" Jul 27 15:54:26.607615 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:26.607444 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 27 15:54:26.608310 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:26.608288 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 27 15:54:26.608681 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:26.608661 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r6vrq" Jul 27 15:54:26.610452 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:26.610432 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 27 15:54:26.610725 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:26.610706 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7x7bj\"" Jul 27 15:54:26.610899 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:26.610712 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 27 15:54:26.610899 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:26.610829 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 27 15:54:26.618396 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:26.618108 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r6vrq"] Jul 27 15:54:26.624550 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:26.624411 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z6kjm"] Jul 27 15:54:26.669664 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:26.669623 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:54:26.693658 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:26.693625 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/709e3495-04dc-42d1-bf57-d706479934c3-config-volume\") pod \"dns-default-z6kjm\" (UID: \"709e3495-04dc-42d1-bf57-d706479934c3\") " pod="openshift-dns/dns-default-z6kjm" Jul 27 15:54:26.693658 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:26.693657 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/709e3495-04dc-42d1-bf57-d706479934c3-metrics-tls\") pod \"dns-default-z6kjm\" (UID: \"709e3495-04dc-42d1-bf57-d706479934c3\") " pod="openshift-dns/dns-default-z6kjm" Jul 27 15:54:26.694042 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:26.693689 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/84071b3f-3bb3-4ce6-8309-95cb35d245ad-cert\") pod \"ingress-canary-r6vrq\" (UID: \"84071b3f-3bb3-4ce6-8309-95cb35d245ad\") " pod="openshift-ingress-canary/ingress-canary-r6vrq" Jul 27 15:54:26.694042 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:26.693823 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/709e3495-04dc-42d1-bf57-d706479934c3-tmp-dir\") pod \"dns-default-z6kjm\" (UID: \"709e3495-04dc-42d1-bf57-d706479934c3\") " pod="openshift-dns/dns-default-z6kjm" Jul 27 15:54:26.694042 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:26.693881 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th582\" (UniqueName: \"kubernetes.io/projected/84071b3f-3bb3-4ce6-8309-95cb35d245ad-kube-api-access-th582\") pod \"ingress-canary-r6vrq\" (UID: \"84071b3f-3bb3-4ce6-8309-95cb35d245ad\") " pod="openshift-ingress-canary/ingress-canary-r6vrq" Jul 27 15:54:26.694042 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:26.693946 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mklg5\" (UniqueName: \"kubernetes.io/projected/709e3495-04dc-42d1-bf57-d706479934c3-kube-api-access-mklg5\") pod \"dns-default-z6kjm\" (UID: \"709e3495-04dc-42d1-bf57-d706479934c3\") " pod="openshift-dns/dns-default-z6kjm" Jul 27 15:54:26.755391 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:26.755351 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:54:26.794454 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:26.794363 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th582\" (UniqueName: \"kubernetes.io/projected/84071b3f-3bb3-4ce6-8309-95cb35d245ad-kube-api-access-th582\") pod \"ingress-canary-r6vrq\" (UID: \"84071b3f-3bb3-4ce6-8309-95cb35d245ad\") " pod="openshift-ingress-canary/ingress-canary-r6vrq" Jul 27 15:54:26.794454 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:26.794414 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mklg5\" (UniqueName: \"kubernetes.io/projected/709e3495-04dc-42d1-bf57-d706479934c3-kube-api-access-mklg5\") pod \"dns-default-z6kjm\" (UID: \"709e3495-04dc-42d1-bf57-d706479934c3\") " pod="openshift-dns/dns-default-z6kjm" Jul 27 15:54:26.794454 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:26.794443 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/709e3495-04dc-42d1-bf57-d706479934c3-config-volume\") pod \"dns-default-z6kjm\" (UID: \"709e3495-04dc-42d1-bf57-d706479934c3\") " pod="openshift-dns/dns-default-z6kjm" Jul 27 15:54:26.794839 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:26.794466 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/709e3495-04dc-42d1-bf57-d706479934c3-metrics-tls\") pod \"dns-default-z6kjm\" (UID: \"709e3495-04dc-42d1-bf57-d706479934c3\") " pod="openshift-dns/dns-default-z6kjm" Jul 27 15:54:26.794839 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:26.794497 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/84071b3f-3bb3-4ce6-8309-95cb35d245ad-cert\") pod \"ingress-canary-r6vrq\" (UID: \"84071b3f-3bb3-4ce6-8309-95cb35d245ad\") " pod="openshift-ingress-canary/ingress-canary-r6vrq" Jul 27 15:54:26.794839 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:26.794556 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/709e3495-04dc-42d1-bf57-d706479934c3-tmp-dir\") pod \"dns-default-z6kjm\" (UID: \"709e3495-04dc-42d1-bf57-d706479934c3\") " pod="openshift-dns/dns-default-z6kjm" Jul 27 15:54:26.794839 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:26.794748 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 15:54:26.794839 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:26.794833 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/709e3495-04dc-42d1-bf57-d706479934c3-metrics-tls podName:709e3495-04dc-42d1-bf57-d706479934c3 nodeName:}" failed. No retries permitted until 2026-07-27 15:54:27.294792583 +0000 UTC m=+38.088518857 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/709e3495-04dc-42d1-bf57-d706479934c3-metrics-tls") pod "dns-default-z6kjm" (UID: "709e3495-04dc-42d1-bf57-d706479934c3") : secret "dns-default-metrics-tls" not found Jul 27 15:54:26.795176 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:26.795150 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/709e3495-04dc-42d1-bf57-d706479934c3-config-volume\") pod \"dns-default-z6kjm\" (UID: \"709e3495-04dc-42d1-bf57-d706479934c3\") " pod="openshift-dns/dns-default-z6kjm" Jul 27 15:54:26.795311 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:26.795253 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/709e3495-04dc-42d1-bf57-d706479934c3-tmp-dir\") pod \"dns-default-z6kjm\" (UID: \"709e3495-04dc-42d1-bf57-d706479934c3\") " pod="openshift-dns/dns-default-z6kjm" Jul 27 15:54:26.800229 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:26.800060 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/84071b3f-3bb3-4ce6-8309-95cb35d245ad-cert\") pod \"ingress-canary-r6vrq\" (UID: \"84071b3f-3bb3-4ce6-8309-95cb35d245ad\") " pod="openshift-ingress-canary/ingress-canary-r6vrq" Jul 27 15:54:26.807015 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:26.806985 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-th582\" (UniqueName: \"kubernetes.io/projected/84071b3f-3bb3-4ce6-8309-95cb35d245ad-kube-api-access-th582\") pod \"ingress-canary-r6vrq\" (UID: \"84071b3f-3bb3-4ce6-8309-95cb35d245ad\") " pod="openshift-ingress-canary/ingress-canary-r6vrq" Jul 27 15:54:26.807376 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:26.807343 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mklg5\" (UniqueName: \"kubernetes.io/projected/709e3495-04dc-42d1-bf57-d706479934c3-kube-api-access-mklg5\") pod \"dns-default-z6kjm\" (UID: \"709e3495-04dc-42d1-bf57-d706479934c3\") " pod="openshift-dns/dns-default-z6kjm" Jul 27 15:54:26.926507 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:26.926468 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r6vrq" Jul 27 15:54:27.086919 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:27.086870 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r6vrq"] Jul 27 15:54:27.092201 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:54:27.092163 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84071b3f_3bb3_4ce6_8309_95cb35d245ad.slice/crio-d49667d71441c75a03e0073d565a1e584feef3405b54d3cc5df34c8a40c0ea74 WatchSource:0}: Error finding container d49667d71441c75a03e0073d565a1e584feef3405b54d3cc5df34c8a40c0ea74: Status 404 returned error can't find the container with id d49667d71441c75a03e0073d565a1e584feef3405b54d3cc5df34c8a40c0ea74 Jul 27 15:54:27.299360 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:27.299324 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/709e3495-04dc-42d1-bf57-d706479934c3-metrics-tls\") pod \"dns-default-z6kjm\" (UID: \"709e3495-04dc-42d1-bf57-d706479934c3\") " pod="openshift-dns/dns-default-z6kjm" Jul 27 15:54:27.299572 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:27.299455 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 15:54:27.299572 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:27.299531 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/709e3495-04dc-42d1-bf57-d706479934c3-metrics-tls podName:709e3495-04dc-42d1-bf57-d706479934c3 nodeName:}" failed. No retries permitted until 2026-07-27 15:54:28.299511035 +0000 UTC m=+39.093237311 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/709e3495-04dc-42d1-bf57-d706479934c3-metrics-tls") pod "dns-default-z6kjm" (UID: "709e3495-04dc-42d1-bf57-d706479934c3") : secret "dns-default-metrics-tls" not found Jul 27 15:54:27.630585 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:27.630544 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2tkp" Jul 27 15:54:27.631374 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:27.630544 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vpk45" Jul 27 15:54:27.631374 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:27.630544 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6khtd" Jul 27 15:54:27.634922 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:27.632861 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 27 15:54:27.634922 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:27.633333 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8zjp2\"" Jul 27 15:54:27.634922 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:27.633604 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 27 15:54:27.634922 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:27.633886 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 27 15:54:27.634922 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:27.634177 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zn8lt\"" Jul 27 15:54:27.634922 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:27.634287 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 27 15:54:27.840530 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:27.840495 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r6vrq" event={"ID":"84071b3f-3bb3-4ce6-8309-95cb35d245ad","Type":"ContainerStarted","Data":"d49667d71441c75a03e0073d565a1e584feef3405b54d3cc5df34c8a40c0ea74"} Jul 27 15:54:28.309640 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:28.309600 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/709e3495-04dc-42d1-bf57-d706479934c3-metrics-tls\") pod \"dns-default-z6kjm\" (UID: \"709e3495-04dc-42d1-bf57-d706479934c3\") " pod="openshift-dns/dns-default-z6kjm" Jul 27 15:54:28.309855 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:28.309748 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 15:54:28.309855 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:28.309831 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/709e3495-04dc-42d1-bf57-d706479934c3-metrics-tls podName:709e3495-04dc-42d1-bf57-d706479934c3 nodeName:}" failed. No retries permitted until 2026-07-27 15:54:30.309795928 +0000 UTC m=+41.103522193 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/709e3495-04dc-42d1-bf57-d706479934c3-metrics-tls") pod "dns-default-z6kjm" (UID: "709e3495-04dc-42d1-bf57-d706479934c3") : secret "dns-default-metrics-tls" not found Jul 27 15:54:29.485484 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:29.485272 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:54:29.585650 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:29.585611 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:54:29.847126 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:29.847092 2561 generic.go:356] "Generic (PLEG): container finished" podID="a28e8365-5281-405d-aa55-bc4ff9a8b671" containerID="270b19cb6cac7bf084053a1e8e2b35bf87b155c918ae057ed3777866f8380a1e" exitCode=0 Jul 27 15:54:29.847292 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:29.847146 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tzdrq" event={"ID":"a28e8365-5281-405d-aa55-bc4ff9a8b671","Type":"ContainerDied","Data":"270b19cb6cac7bf084053a1e8e2b35bf87b155c918ae057ed3777866f8380a1e"} Jul 27 15:54:29.958481 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:29.958445 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:54:30.060544 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:30.060486 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:54:30.326502 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:30.326460 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/709e3495-04dc-42d1-bf57-d706479934c3-metrics-tls\") pod \"dns-default-z6kjm\" (UID: \"709e3495-04dc-42d1-bf57-d706479934c3\") " pod="openshift-dns/dns-default-z6kjm" Jul 27 15:54:30.327040 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:30.327008 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 15:54:30.327165 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:30.327107 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/709e3495-04dc-42d1-bf57-d706479934c3-metrics-tls podName:709e3495-04dc-42d1-bf57-d706479934c3 nodeName:}" failed. No retries permitted until 2026-07-27 15:54:34.327084129 +0000 UTC m=+45.120810406 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/709e3495-04dc-42d1-bf57-d706479934c3-metrics-tls") pod "dns-default-z6kjm" (UID: "709e3495-04dc-42d1-bf57-d706479934c3") : secret "dns-default-metrics-tls" not found Jul 27 15:54:30.852283 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:30.852245 2561 generic.go:356] "Generic (PLEG): container finished" podID="a28e8365-5281-405d-aa55-bc4ff9a8b671" containerID="03fc3ac5e602ea5ac6eeb7fc49dd7f01bfe4dbdfd7d642e1862225d118c0eefc" exitCode=0 Jul 27 15:54:30.852662 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:30.852301 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tzdrq" event={"ID":"a28e8365-5281-405d-aa55-bc4ff9a8b671","Type":"ContainerDied","Data":"03fc3ac5e602ea5ac6eeb7fc49dd7f01bfe4dbdfd7d642e1862225d118c0eefc"} Jul 27 15:54:31.630400 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:31.630370 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:54:31.716946 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:31.716910 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:54:31.810339 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:31.810308 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:54:31.855972 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:31.855934 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r6vrq" event={"ID":"84071b3f-3bb3-4ce6-8309-95cb35d245ad","Type":"ContainerStarted","Data":"9ff8ce34d31a9b27cf92200d2f6edf420fec6e0f6f291a75f62d3e5c9c378552"} Jul 27 15:54:31.859349 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:31.859317 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tzdrq" event={"ID":"a28e8365-5281-405d-aa55-bc4ff9a8b671","Type":"ContainerStarted","Data":"0821a6417a84639c15f8bc2239a75ae83125bf22b1203fa59d92cf3c897bc77a"} Jul 27 15:54:31.872295 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:31.872242 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-r6vrq" podStartSLOduration=1.766338305 podStartE2EDuration="5.872223212s" totalImagesPullingTime="4.105884907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:54:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:54:31.871515224 +0000 UTC m=+42.665241547" watchObservedRunningTime="2026-07-27 15:54:31.872223212 +0000 UTC m=+42.665949469" Jul 27 15:54:31.894015 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:31.893886 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tzdrq" podStartSLOduration=12.845599126 podStartE2EDuration="41.893839808s" totalImagesPullingTime="29.048240682s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 15:53:50 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:54:31.893664901 +0000 UTC m=+42.687391179" watchObservedRunningTime="2026-07-27 15:54:31.893839808 +0000 UTC m=+42.687566086" Jul 27 15:54:32.017571 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:32.017495 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:54:32.118215 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:32.118163 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:54:34.353903 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:34.353858 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/709e3495-04dc-42d1-bf57-d706479934c3-metrics-tls\") pod \"dns-default-z6kjm\" (UID: \"709e3495-04dc-42d1-bf57-d706479934c3\") " pod="openshift-dns/dns-default-z6kjm" Jul 27 15:54:34.354409 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:34.354039 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 15:54:34.354409 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:34.354131 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/709e3495-04dc-42d1-bf57-d706479934c3-metrics-tls podName:709e3495-04dc-42d1-bf57-d706479934c3 nodeName:}" failed. No retries permitted until 2026-07-27 15:54:42.354107364 +0000 UTC m=+53.147833620 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/709e3495-04dc-42d1-bf57-d706479934c3-metrics-tls") pod "dns-default-z6kjm" (UID: "709e3495-04dc-42d1-bf57-d706479934c3") : secret "dns-default-metrics-tls" not found Jul 27 15:54:37.071304 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:37.071265 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:54:37.172041 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:37.171996 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:54:42.339331 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:42.339297 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:54:42.405944 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:42.405901 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/709e3495-04dc-42d1-bf57-d706479934c3-metrics-tls\") pod \"dns-default-z6kjm\" (UID: \"709e3495-04dc-42d1-bf57-d706479934c3\") " pod="openshift-dns/dns-default-z6kjm" Jul 27 15:54:42.406077 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:42.406058 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 15:54:42.406142 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:42.406129 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/709e3495-04dc-42d1-bf57-d706479934c3-metrics-tls podName:709e3495-04dc-42d1-bf57-d706479934c3 nodeName:}" failed. No retries permitted until 2026-07-27 15:54:58.40611165 +0000 UTC m=+69.199837913 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/709e3495-04dc-42d1-bf57-d706479934c3-metrics-tls") pod "dns-default-z6kjm" (UID: "709e3495-04dc-42d1-bf57-d706479934c3") : secret "dns-default-metrics-tls" not found Jul 27 15:54:44.207447 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:44.207386 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:54:44.277107 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:44.277059 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:54:46.729463 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:46.729404 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:54:46.830611 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:46.830565 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:54:51.840076 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:51.840046 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8mnsv" Jul 27 15:54:52.002064 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:52.002031 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:54:52.084218 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:52.084168 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:54:53.676660 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:53.676623 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:54:53.753550 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:53.753483 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:54:55.297097 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:55.297055 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2875ea72-06f8-4c75-b39b-2524b82f6875-metrics-certs\") pod \"network-metrics-daemon-vpk45\" (UID: \"2875ea72-06f8-4c75-b39b-2524b82f6875\") " pod="openshift-multus/network-metrics-daemon-vpk45" Jul 27 15:54:55.297521 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:55.297117 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db554c84-03a7-4127-8c5b-c7c18897237d-original-pull-secret\") pod \"global-pull-secret-syncer-v2tkp\" (UID: \"db554c84-03a7-4127-8c5b-c7c18897237d\") " pod="kube-system/global-pull-secret-syncer-v2tkp" Jul 27 15:54:55.299574 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:55.299551 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 27 15:54:55.299697 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:55.299602 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 27 15:54:55.307966 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:55.307939 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 27 15:54:55.308105 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:55.308006 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2875ea72-06f8-4c75-b39b-2524b82f6875-metrics-certs podName:2875ea72-06f8-4c75-b39b-2524b82f6875 nodeName:}" failed. No retries permitted until 2026-07-27 15:55:59.307989318 +0000 UTC m=+130.101715578 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2875ea72-06f8-4c75-b39b-2524b82f6875-metrics-certs") pod "network-metrics-daemon-vpk45" (UID: "2875ea72-06f8-4c75-b39b-2524b82f6875") : secret "metrics-daemon-secret" not found Jul 27 15:54:55.311137 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:55.311115 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db554c84-03a7-4127-8c5b-c7c18897237d-original-pull-secret\") pod \"global-pull-secret-syncer-v2tkp\" (UID: \"db554c84-03a7-4127-8c5b-c7c18897237d\") " pod="kube-system/global-pull-secret-syncer-v2tkp" Jul 27 15:54:55.498113 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:55.498067 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsdnn\" (UniqueName: \"kubernetes.io/projected/26984101-b8ab-4b8c-9272-2cc91f0e2ee9-kube-api-access-rsdnn\") pod \"network-check-target-6khtd\" (UID: \"26984101-b8ab-4b8c-9272-2cc91f0e2ee9\") " pod="openshift-network-diagnostics/network-check-target-6khtd" Jul 27 15:54:55.500811 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:55.500783 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 27 15:54:55.510724 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:55.510701 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 27 15:54:55.522553 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:55.522530 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsdnn\" (UniqueName: \"kubernetes.io/projected/26984101-b8ab-4b8c-9272-2cc91f0e2ee9-kube-api-access-rsdnn\") pod \"network-check-target-6khtd\" (UID: \"26984101-b8ab-4b8c-9272-2cc91f0e2ee9\") " pod="openshift-network-diagnostics/network-check-target-6khtd" Jul 27 15:54:55.546904 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:55.546868 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2tkp" Jul 27 15:54:55.560932 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:55.560910 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zn8lt\"" Jul 27 15:54:55.569399 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:55.569366 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6khtd" Jul 27 15:54:55.701458 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:55.701381 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-v2tkp"] Jul 27 15:54:55.706621 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:54:55.706583 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb554c84_03a7_4127_8c5b_c7c18897237d.slice/crio-50ded60ccfbf249574f57dee0c8ecf478e3ce677ce273daf5f071122817d8a0d WatchSource:0}: Error finding container 50ded60ccfbf249574f57dee0c8ecf478e3ce677ce273daf5f071122817d8a0d: Status 404 returned error can't find the container with id 50ded60ccfbf249574f57dee0c8ecf478e3ce677ce273daf5f071122817d8a0d Jul 27 15:54:55.738850 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:55.738819 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6khtd"] Jul 27 15:54:55.743137 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:54:55.743101 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26984101_b8ab_4b8c_9272_2cc91f0e2ee9.slice/crio-f8e852a303922a3536d909aad9bc93b7498251128069aedb4cfa760617719eb4 WatchSource:0}: Error finding container f8e852a303922a3536d909aad9bc93b7498251128069aedb4cfa760617719eb4: Status 404 returned error can't find the container with id f8e852a303922a3536d909aad9bc93b7498251128069aedb4cfa760617719eb4 Jul 27 15:54:55.916564 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:55.916459 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6khtd" event={"ID":"26984101-b8ab-4b8c-9272-2cc91f0e2ee9","Type":"ContainerStarted","Data":"f8e852a303922a3536d909aad9bc93b7498251128069aedb4cfa760617719eb4"} Jul 27 15:54:55.917429 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:55.917392 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-v2tkp" event={"ID":"db554c84-03a7-4127-8c5b-c7c18897237d","Type":"ContainerStarted","Data":"50ded60ccfbf249574f57dee0c8ecf478e3ce677ce273daf5f071122817d8a0d"} Jul 27 15:54:58.418024 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:58.417981 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/709e3495-04dc-42d1-bf57-d706479934c3-metrics-tls\") pod \"dns-default-z6kjm\" (UID: \"709e3495-04dc-42d1-bf57-d706479934c3\") " pod="openshift-dns/dns-default-z6kjm" Jul 27 15:54:58.418509 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:58.418095 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 15:54:58.418509 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:54:58.418172 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/709e3495-04dc-42d1-bf57-d706479934c3-metrics-tls podName:709e3495-04dc-42d1-bf57-d706479934c3 nodeName:}" failed. No retries permitted until 2026-07-27 15:55:30.418153153 +0000 UTC m=+101.211879416 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/709e3495-04dc-42d1-bf57-d706479934c3-metrics-tls") pod "dns-default-z6kjm" (UID: "709e3495-04dc-42d1-bf57-d706479934c3") : secret "dns-default-metrics-tls" not found Jul 27 15:54:59.955543 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:59.955507 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65f4f9bfdd-c4lc9"] Jul 27 15:54:59.957456 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:59.957434 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65f4f9bfdd-c4lc9" Jul 27 15:54:59.959948 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:59.959919 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 27 15:54:59.960076 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:59.959949 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-lvdn5\"" Jul 27 15:54:59.960076 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:59.960030 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 27 15:54:59.960076 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:59.959922 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 27 15:54:59.960235 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:59.959919 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 27 15:54:59.966714 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:54:59.966690 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65f4f9bfdd-c4lc9"] Jul 27 15:55:00.009623 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:55:00.009586 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8548b87658-7dpf8"] Jul 27 15:55:00.015754 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:55:00.015723 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8548b87658-7dpf8" Jul 27 15:55:00.021136 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:55:00.020940 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 27 15:55:00.021379 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:55:00.021348 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 27 15:55:00.021515 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:55:00.021497 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 27 15:55:00.021638 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:55:00.021623 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 27 15:55:00.031096 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:55:00.031072 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/fcf0201b-e45d-44e4-af67-a3f24cb6e1a4-ca\") pod \"cluster-proxy-proxy-agent-8548b87658-7dpf8\" (UID: \"fcf0201b-e45d-44e4-af67-a3f24cb6e1a4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8548b87658-7dpf8" Jul 27 15:55:00.031215 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:55:00.031104 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/fcf0201b-e45d-44e4-af67-a3f24cb6e1a4-hub\") pod \"cluster-proxy-proxy-agent-8548b87658-7dpf8\" (UID: \"fcf0201b-e45d-44e4-af67-a3f24cb6e1a4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8548b87658-7dpf8" Jul 27 15:55:00.031215 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:55:00.031127 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fcf0201b-e45d-44e4-af67-a3f24cb6e1a4-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-8548b87658-7dpf8\" (UID: \"fcf0201b-e45d-44e4-af67-a3f24cb6e1a4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8548b87658-7dpf8" Jul 27 15:55:00.031321 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:55:00.031209 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b2819253-1a0a-42b0-a6b3-461455d2c7e5-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-65f4f9bfdd-c4lc9\" (UID: \"b2819253-1a0a-42b0-a6b3-461455d2c7e5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65f4f9bfdd-c4lc9" Jul 27 15:55:00.031321 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:55:00.031235 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fndzv\" (UniqueName: \"kubernetes.io/projected/fcf0201b-e45d-44e4-af67-a3f24cb6e1a4-kube-api-access-fndzv\") pod \"cluster-proxy-proxy-agent-8548b87658-7dpf8\" (UID: \"fcf0201b-e45d-44e4-af67-a3f24cb6e1a4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8548b87658-7dpf8" Jul 27 15:55:00.031321 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:55:00.031271 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcf0201b-e45d-44e4-af67-a3f24cb6e1a4-additional-service-ca\") pod \"cluster-proxy-proxy-agent-8548b87658-7dpf8\" (UID: \"fcf0201b-e45d-44e4-af67-a3f24cb6e1a4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8548b87658-7dpf8" Jul 27 15:55:00.031413 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:55:00.031316 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/fcf0201b-e45d-44e4-af67-a3f24cb6e1a4-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-8548b87658-7dpf8\" (UID: \"fcf0201b-e45d-44e4-af67-a3f24cb6e1a4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8548b87658-7dpf8" Jul 27 15:55:00.031413 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:55:00.031397 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9dqt\" (UniqueName: \"kubernetes.io/projected/b2819253-1a0a-42b0-a6b3-461455d2c7e5-kube-api-access-z9dqt\") pod \"managed-serviceaccount-addon-agent-65f4f9bfdd-c4lc9\" (UID: \"b2819253-1a0a-42b0-a6b3-461455d2c7e5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65f4f9bfdd-c4lc9" Jul 27 15:55:00.036737 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:55:00.036716 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8548b87658-7dpf8"] Jul 27 15:55:00.132423 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:55:00.132376 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcf0201b-e45d-44e4-af67-a3f24cb6e1a4-additional-service-ca\") pod \"cluster-proxy-proxy-agent-8548b87658-7dpf8\" (UID: \"fcf0201b-e45d-44e4-af67-a3f24cb6e1a4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8548b87658-7dpf8" Jul 27 15:55:00.132423 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:55:00.132427 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/fcf0201b-e45d-44e4-af67-a3f24cb6e1a4-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-8548b87658-7dpf8\" (UID: \"fcf0201b-e45d-44e4-af67-a3f24cb6e1a4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8548b87658-7dpf8" Jul 27 15:55:00.132679 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:55:00.132477 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9dqt\" (UniqueName: \"kubernetes.io/projected/b2819253-1a0a-42b0-a6b3-461455d2c7e5-kube-api-access-z9dqt\") pod \"managed-serviceaccount-addon-agent-65f4f9bfdd-c4lc9\" (UID: \"b2819253-1a0a-42b0-a6b3-461455d2c7e5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65f4f9bfdd-c4lc9" Jul 27 15:55:00.132679 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:55:00.132528 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/fcf0201b-e45d-44e4-af67-a3f24cb6e1a4-ca\") pod \"cluster-proxy-proxy-agent-8548b87658-7dpf8\" (UID: \"fcf0201b-e45d-44e4-af67-a3f24cb6e1a4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8548b87658-7dpf8" Jul 27 15:55:00.132679 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:55:00.132551 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/fcf0201b-e45d-44e4-af67-a3f24cb6e1a4-hub\") pod \"cluster-proxy-proxy-agent-8548b87658-7dpf8\" (UID: \"fcf0201b-e45d-44e4-af67-a3f24cb6e1a4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8548b87658-7dpf8" Jul 27 15:55:00.132679 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:55:00.132577 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fcf0201b-e45d-44e4-af67-a3f24cb6e1a4-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-8548b87658-7dpf8\" (UID: \"fcf0201b-e45d-44e4-af67-a3f24cb6e1a4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8548b87658-7dpf8" Jul 27 15:55:00.132679 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:55:00.132624 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b2819253-1a0a-42b0-a6b3-461455d2c7e5-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-65f4f9bfdd-c4lc9\" (UID: \"b2819253-1a0a-42b0-a6b3-461455d2c7e5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65f4f9bfdd-c4lc9" Jul 27 15:55:00.132679 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:55:00.132649 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fndzv\" (UniqueName: \"kubernetes.io/projected/fcf0201b-e45d-44e4-af67-a3f24cb6e1a4-kube-api-access-fndzv\") pod \"cluster-proxy-proxy-agent-8548b87658-7dpf8\" (UID: \"fcf0201b-e45d-44e4-af67-a3f24cb6e1a4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8548b87658-7dpf8" Jul 27 15:55:00.133325 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:55:00.133272 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcf0201b-e45d-44e4-af67-a3f24cb6e1a4-additional-service-ca\") pod \"cluster-proxy-proxy-agent-8548b87658-7dpf8\" (UID: \"fcf0201b-e45d-44e4-af67-a3f24cb6e1a4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8548b87658-7dpf8" Jul 27 15:55:00.135851 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:55:00.135819 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/fcf0201b-e45d-44e4-af67-a3f24cb6e1a4-hub\") pod \"cluster-proxy-proxy-agent-8548b87658-7dpf8\" (UID: \"fcf0201b-e45d-44e4-af67-a3f24cb6e1a4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8548b87658-7dpf8" Jul 27 15:55:00.135987 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:55:00.135910 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/fcf0201b-e45d-44e4-af67-a3f24cb6e1a4-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-8548b87658-7dpf8\" (UID: \"fcf0201b-e45d-44e4-af67-a3f24cb6e1a4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8548b87658-7dpf8" Jul 27 15:55:00.136049 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:55:00.135991 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b2819253-1a0a-42b0-a6b3-461455d2c7e5-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-65f4f9bfdd-c4lc9\" (UID: \"b2819253-1a0a-42b0-a6b3-461455d2c7e5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65f4f9bfdd-c4lc9" Jul 27 15:55:00.136108 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:55:00.136060 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fcf0201b-e45d-44e4-af67-a3f24cb6e1a4-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-8548b87658-7dpf8\" (UID: \"fcf0201b-e45d-44e4-af67-a3f24cb6e1a4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8548b87658-7dpf8" Jul 27 15:55:00.136446 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:55:00.136426 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/fcf0201b-e45d-44e4-af67-a3f24cb6e1a4-ca\") pod \"cluster-proxy-proxy-agent-8548b87658-7dpf8\" (UID: \"fcf0201b-e45d-44e4-af67-a3f24cb6e1a4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8548b87658-7dpf8" Jul 27 15:55:00.149622 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:55:00.149592 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fndzv\" (UniqueName: \"kubernetes.io/projected/fcf0201b-e45d-44e4-af67-a3f24cb6e1a4-kube-api-access-fndzv\") pod \"cluster-proxy-proxy-agent-8548b87658-7dpf8\" (UID: \"fcf0201b-e45d-44e4-af67-a3f24cb6e1a4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8548b87658-7dpf8" Jul 27 15:55:00.149762 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:55:00.149621 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9dqt\" (UniqueName: \"kubernetes.io/projected/b2819253-1a0a-42b0-a6b3-461455d2c7e5-kube-api-access-z9dqt\") pod \"managed-serviceaccount-addon-agent-65f4f9bfdd-c4lc9\" (UID: \"b2819253-1a0a-42b0-a6b3-461455d2c7e5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65f4f9bfdd-c4lc9" Jul 27 15:55:00.275879 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:55:00.275776 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65f4f9bfdd-c4lc9" Jul 27 15:55:00.325988 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:55:00.325946 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8548b87658-7dpf8" Jul 27 15:55:00.560531 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:55:00.560497 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8548b87658-7dpf8"] Jul 27 15:55:00.564629 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:55:00.564595 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfcf0201b_e45d_44e4_af67_a3f24cb6e1a4.slice/crio-750aab53538ccf085a59a7f0117e75c49222dcbcfa5064ce7d69ed8819d312c9 WatchSource:0}: Error finding container 750aab53538ccf085a59a7f0117e75c49222dcbcfa5064ce7d69ed8819d312c9: Status 404 returned error can't find the container with id 750aab53538ccf085a59a7f0117e75c49222dcbcfa5064ce7d69ed8819d312c9 Jul 27 15:55:00.565067 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:55:00.565037 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65f4f9bfdd-c4lc9"] Jul 27 15:55:00.568964 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:55:00.568935 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb2819253_1a0a_42b0_a6b3_461455d2c7e5.slice/crio-7364f64075f88ca59dba0cf5db0985a2e09e04f0def60c3c568966919d6313d3 WatchSource:0}: Error finding container 7364f64075f88ca59dba0cf5db0985a2e09e04f0def60c3c568966919d6313d3: Status 404 returned error can't find the container with id 7364f64075f88ca59dba0cf5db0985a2e09e04f0def60c3c568966919d6313d3 Jul 27 15:55:00.933138 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:55:00.933097 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6khtd" event={"ID":"26984101-b8ab-4b8c-9272-2cc91f0e2ee9","Type":"ContainerStarted","Data":"28b37bc3e69d198d29ba6eda28edae161009d9aade88d8b709b60450e4013d6c"} Jul 27 15:55:00.933340 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:55:00.933230 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-6khtd" Jul 27 15:55:00.934377 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:55:00.934354 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65f4f9bfdd-c4lc9" event={"ID":"b2819253-1a0a-42b0-a6b3-461455d2c7e5","Type":"ContainerStarted","Data":"7364f64075f88ca59dba0cf5db0985a2e09e04f0def60c3c568966919d6313d3"} Jul 27 15:55:00.935794 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:55:00.935762 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-v2tkp" event={"ID":"db554c84-03a7-4127-8c5b-c7c18897237d","Type":"ContainerStarted","Data":"60ac0d5422b4ac0f0d610d875ee0873542d82af5b3fbc520f0db4e0fc0193faf"} Jul 27 15:55:00.936887 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:55:00.936867 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8548b87658-7dpf8" event={"ID":"fcf0201b-e45d-44e4-af67-a3f24cb6e1a4","Type":"ContainerStarted","Data":"750aab53538ccf085a59a7f0117e75c49222dcbcfa5064ce7d69ed8819d312c9"} Jul 27 15:55:00.947984 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:55:00.947940 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-6khtd" podStartSLOduration=66.285386987 podStartE2EDuration="1m10.947926489s" totalImagesPullingTime="4.662539502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:53:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:55:00.946826749 +0000 UTC m=+71.740553019" watchObservedRunningTime="2026-07-27 15:55:00.947926489 +0000 UTC m=+71.741652767" Jul 27 15:55:00.960371 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:55:00.960305 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-v2tkp" podStartSLOduration=66.244291642 podStartE2EDuration="1m10.960287265s" totalImagesPullingTime="4.715995623s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 15:53:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:55:00.959697811 +0000 UTC m=+71.753424089" watchObservedRunningTime="2026-07-27 15:55:00.960287265 +0000 UTC m=+71.754013524" Jul 27 15:55:03.707111 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:55:03.707070 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:55:03.767981 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:55:03.767928 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:55:03.837653 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:55:03.837600 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:55:04.953434 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:55:04.953403 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65f4f9bfdd-c4lc9" event={"ID":"b2819253-1a0a-42b0-a6b3-461455d2c7e5","Type":"ContainerStarted","Data":"11701008c34f01c445897cf7a9ff4a67edba77b1264f6cf01f8bab73a8de89bc"} Jul 27 15:55:04.954842 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:55:04.954818 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8548b87658-7dpf8" event={"ID":"fcf0201b-e45d-44e4-af67-a3f24cb6e1a4","Type":"ContainerStarted","Data":"06e09e14f3dfeefae61080a118be145dbec9420b8b2660dbac912993efddc787"} Jul 27 15:55:04.968353 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:55:04.968300 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65f4f9bfdd-c4lc9" podStartSLOduration=1.700976179 podStartE2EDuration="5.968283209s" totalImagesPullingTime="4.26730703s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:54:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:55:04.96748023 +0000 UTC m=+75.761206526" watchObservedRunningTime="2026-07-27 15:55:04.968283209 +0000 UTC m=+75.762009489" Jul 27 15:55:05.959464 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:55:05.959424 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8548b87658-7dpf8" event={"ID":"fcf0201b-e45d-44e4-af67-a3f24cb6e1a4","Type":"ContainerStarted","Data":"d4dbf0da15470637f3e288b6dc2451bc8a453850279eb7cb0f30a3741b0c7a48"} Jul 27 15:55:05.959464 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:55:05.959471 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8548b87658-7dpf8" event={"ID":"fcf0201b-e45d-44e4-af67-a3f24cb6e1a4","Type":"ContainerStarted","Data":"ffa5468852ab8044f4c89d328f93421a7e7b218a72801598c01b1c111d794f8f"} Jul 27 15:55:05.979997 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:55:05.979944 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8548b87658-7dpf8" podStartSLOduration=2.696049649 podStartE2EDuration="6.979928318s" totalImagesPullingTime="4.283878669s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:54:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:55:05.979519662 +0000 UTC m=+76.773245949" watchObservedRunningTime="2026-07-27 15:55:05.979928318 +0000 UTC m=+76.773654596" Jul 27 15:55:06.767726 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:55:06.767693 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:55:30.457303 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:55:30.457244 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/709e3495-04dc-42d1-bf57-d706479934c3-metrics-tls\") pod \"dns-default-z6kjm\" (UID: \"709e3495-04dc-42d1-bf57-d706479934c3\") " pod="openshift-dns/dns-default-z6kjm" Jul 27 15:55:30.457770 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:55:30.457418 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 15:55:30.457770 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:55:30.457493 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/709e3495-04dc-42d1-bf57-d706479934c3-metrics-tls podName:709e3495-04dc-42d1-bf57-d706479934c3 nodeName:}" failed. No retries permitted until 2026-07-27 15:56:34.457476174 +0000 UTC m=+165.251202431 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/709e3495-04dc-42d1-bf57-d706479934c3-metrics-tls") pod "dns-default-z6kjm" (UID: "709e3495-04dc-42d1-bf57-d706479934c3") : secret "dns-default-metrics-tls" not found Jul 27 15:55:31.945738 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:55:31.945708 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-6khtd" Jul 27 15:55:59.356087 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:55:59.356042 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2875ea72-06f8-4c75-b39b-2524b82f6875-metrics-certs\") pod \"network-metrics-daemon-vpk45\" (UID: \"2875ea72-06f8-4c75-b39b-2524b82f6875\") " pod="openshift-multus/network-metrics-daemon-vpk45" Jul 27 15:55:59.356592 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:55:59.356207 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 27 15:55:59.356592 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:55:59.356276 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2875ea72-06f8-4c75-b39b-2524b82f6875-metrics-certs podName:2875ea72-06f8-4c75-b39b-2524b82f6875 nodeName:}" failed. No retries permitted until 2026-07-27 15:58:01.356260325 +0000 UTC m=+252.149986587 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2875ea72-06f8-4c75-b39b-2524b82f6875-metrics-certs") pod "network-metrics-daemon-vpk45" (UID: "2875ea72-06f8-4c75-b39b-2524b82f6875") : secret "metrics-daemon-secret" not found Jul 27 15:56:29.619628 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:56:29.619527 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-z6kjm" podUID="709e3495-04dc-42d1-bf57-d706479934c3" Jul 27 15:56:30.197703 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:56:30.197666 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z6kjm" Jul 27 15:56:30.653719 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:56:30.653678 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-vpk45" podUID="2875ea72-06f8-4c75-b39b-2524b82f6875" Jul 27 15:56:34.505442 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:56:34.505395 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/709e3495-04dc-42d1-bf57-d706479934c3-metrics-tls\") pod \"dns-default-z6kjm\" (UID: \"709e3495-04dc-42d1-bf57-d706479934c3\") " pod="openshift-dns/dns-default-z6kjm" Jul 27 15:56:34.505939 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:56:34.505550 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 15:56:34.505939 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:56:34.505612 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/709e3495-04dc-42d1-bf57-d706479934c3-metrics-tls podName:709e3495-04dc-42d1-bf57-d706479934c3 nodeName:}" failed. No retries permitted until 2026-07-27 15:58:36.505596617 +0000 UTC m=+287.299322877 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/709e3495-04dc-42d1-bf57-d706479934c3-metrics-tls") pod "dns-default-z6kjm" (UID: "709e3495-04dc-42d1-bf57-d706479934c3") : secret "dns-default-metrics-tls" not found Jul 27 15:56:45.631304 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:56:45.631197 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vpk45" Jul 27 15:57:05.301658 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:57:05.301627 2561 generic.go:356] "Generic (PLEG): container finished" podID="b2819253-1a0a-42b0-a6b3-461455d2c7e5" containerID="11701008c34f01c445897cf7a9ff4a67edba77b1264f6cf01f8bab73a8de89bc" exitCode=255 Jul 27 15:57:05.302144 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:57:05.301686 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65f4f9bfdd-c4lc9" event={"ID":"b2819253-1a0a-42b0-a6b3-461455d2c7e5","Type":"ContainerDied","Data":"11701008c34f01c445897cf7a9ff4a67edba77b1264f6cf01f8bab73a8de89bc"} Jul 27 15:57:05.302144 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:57:05.301980 2561 scope.go:117] "RemoveContainer" containerID="11701008c34f01c445897cf7a9ff4a67edba77b1264f6cf01f8bab73a8de89bc" Jul 27 15:57:06.306479 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:57:06.306442 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65f4f9bfdd-c4lc9" event={"ID":"b2819253-1a0a-42b0-a6b3-461455d2c7e5","Type":"ContainerStarted","Data":"825b87edf688e5a5483815d6dad6af54ef0becb5be48fd4a02f65e5eba9caa4d"} Jul 27 15:57:07.204383 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:57:07.204348 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:57:48.098966 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:57:48.098926 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:01.427713 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:01.427670 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2875ea72-06f8-4c75-b39b-2524b82f6875-metrics-certs\") pod \"network-metrics-daemon-vpk45\" (UID: \"2875ea72-06f8-4c75-b39b-2524b82f6875\") " pod="openshift-multus/network-metrics-daemon-vpk45" Jul 27 15:58:01.428214 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:58:01.427788 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 27 15:58:01.428214 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:58:01.427859 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2875ea72-06f8-4c75-b39b-2524b82f6875-metrics-certs podName:2875ea72-06f8-4c75-b39b-2524b82f6875 nodeName:}" failed. No retries permitted until 2026-07-27 16:00:03.427844809 +0000 UTC m=+374.221571066 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2875ea72-06f8-4c75-b39b-2524b82f6875-metrics-certs") pod "network-metrics-daemon-vpk45" (UID: "2875ea72-06f8-4c75-b39b-2524b82f6875") : secret "metrics-daemon-secret" not found Jul 27 15:58:10.510751 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:10.510713 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:10.609784 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:10.609752 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:14.435332 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:14.435254 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:14.504927 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:14.504895 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:14.875019 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:14.874986 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:14.978210 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:14.978172 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:15.052744 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:15.052710 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-x2m5m"] Jul 27 15:58:15.055748 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:15.055727 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x2m5m" Jul 27 15:58:15.057656 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:15.057635 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 27 15:58:15.058186 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:15.058168 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 27 15:58:15.058259 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:15.058190 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-56g4v\"" Jul 27 15:58:15.058259 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:15.058231 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 27 15:58:15.058448 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:15.058432 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 27 15:58:15.067524 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:15.067493 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x2m5m"] Jul 27 15:58:15.122206 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:15.122163 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d1324c9-b8ce-4851-afdc-bbeb88355160-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x2m5m\" (UID: \"7d1324c9-b8ce-4851-afdc-bbeb88355160\") " pod="openshift-insights/insights-runtime-extractor-x2m5m" Jul 27 15:58:15.122206 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:15.122208 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d1324c9-b8ce-4851-afdc-bbeb88355160-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x2m5m\" (UID: \"7d1324c9-b8ce-4851-afdc-bbeb88355160\") " pod="openshift-insights/insights-runtime-extractor-x2m5m" Jul 27 15:58:15.122427 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:15.122295 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d1324c9-b8ce-4851-afdc-bbeb88355160-data-volume\") pod \"insights-runtime-extractor-x2m5m\" (UID: \"7d1324c9-b8ce-4851-afdc-bbeb88355160\") " pod="openshift-insights/insights-runtime-extractor-x2m5m" Jul 27 15:58:15.122427 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:15.122337 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtbcb\" (UniqueName: \"kubernetes.io/projected/7d1324c9-b8ce-4851-afdc-bbeb88355160-kube-api-access-vtbcb\") pod \"insights-runtime-extractor-x2m5m\" (UID: \"7d1324c9-b8ce-4851-afdc-bbeb88355160\") " pod="openshift-insights/insights-runtime-extractor-x2m5m" Jul 27 15:58:15.122427 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:15.122361 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7d1324c9-b8ce-4851-afdc-bbeb88355160-crio-socket\") pod \"insights-runtime-extractor-x2m5m\" (UID: \"7d1324c9-b8ce-4851-afdc-bbeb88355160\") " pod="openshift-insights/insights-runtime-extractor-x2m5m" Jul 27 15:58:15.223403 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:15.223305 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d1324c9-b8ce-4851-afdc-bbeb88355160-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x2m5m\" (UID: \"7d1324c9-b8ce-4851-afdc-bbeb88355160\") " pod="openshift-insights/insights-runtime-extractor-x2m5m" Jul 27 15:58:15.223403 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:15.223345 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d1324c9-b8ce-4851-afdc-bbeb88355160-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x2m5m\" (UID: \"7d1324c9-b8ce-4851-afdc-bbeb88355160\") " pod="openshift-insights/insights-runtime-extractor-x2m5m" Jul 27 15:58:15.223403 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:15.223380 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d1324c9-b8ce-4851-afdc-bbeb88355160-data-volume\") pod \"insights-runtime-extractor-x2m5m\" (UID: \"7d1324c9-b8ce-4851-afdc-bbeb88355160\") " pod="openshift-insights/insights-runtime-extractor-x2m5m" Jul 27 15:58:15.223637 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:15.223410 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtbcb\" (UniqueName: \"kubernetes.io/projected/7d1324c9-b8ce-4851-afdc-bbeb88355160-kube-api-access-vtbcb\") pod \"insights-runtime-extractor-x2m5m\" (UID: \"7d1324c9-b8ce-4851-afdc-bbeb88355160\") " pod="openshift-insights/insights-runtime-extractor-x2m5m" Jul 27 15:58:15.223637 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:15.223433 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7d1324c9-b8ce-4851-afdc-bbeb88355160-crio-socket\") pod \"insights-runtime-extractor-x2m5m\" (UID: \"7d1324c9-b8ce-4851-afdc-bbeb88355160\") " pod="openshift-insights/insights-runtime-extractor-x2m5m" Jul 27 15:58:15.223637 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:58:15.223488 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 15:58:15.223637 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:15.223505 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7d1324c9-b8ce-4851-afdc-bbeb88355160-crio-socket\") pod \"insights-runtime-extractor-x2m5m\" (UID: \"7d1324c9-b8ce-4851-afdc-bbeb88355160\") " pod="openshift-insights/insights-runtime-extractor-x2m5m" Jul 27 15:58:15.223637 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:58:15.223555 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d1324c9-b8ce-4851-afdc-bbeb88355160-insights-runtime-extractor-tls podName:7d1324c9-b8ce-4851-afdc-bbeb88355160 nodeName:}" failed. No retries permitted until 2026-07-27 15:58:15.723538731 +0000 UTC m=+266.517264988 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7d1324c9-b8ce-4851-afdc-bbeb88355160-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x2m5m" (UID: "7d1324c9-b8ce-4851-afdc-bbeb88355160") : secret "insights-runtime-extractor-tls" not found Jul 27 15:58:15.223637 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:58:15.223499 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 15:58:15.223637 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:58:15.223615 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7d1324c9-b8ce-4851-afdc-bbeb88355160-kube-rbac-proxy-cm podName:7d1324c9-b8ce-4851-afdc-bbeb88355160 nodeName:}" failed. No retries permitted until 2026-07-27 15:58:15.723603572 +0000 UTC m=+266.517329858 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7d1324c9-b8ce-4851-afdc-bbeb88355160-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x2m5m" (UID: "7d1324c9-b8ce-4851-afdc-bbeb88355160") : configmap "kube-rbac-proxy" not found Jul 27 15:58:15.223915 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:15.223760 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d1324c9-b8ce-4851-afdc-bbeb88355160-data-volume\") pod \"insights-runtime-extractor-x2m5m\" (UID: \"7d1324c9-b8ce-4851-afdc-bbeb88355160\") " pod="openshift-insights/insights-runtime-extractor-x2m5m" Jul 27 15:58:15.233312 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:15.233288 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtbcb\" (UniqueName: \"kubernetes.io/projected/7d1324c9-b8ce-4851-afdc-bbeb88355160-kube-api-access-vtbcb\") pod \"insights-runtime-extractor-x2m5m\" (UID: \"7d1324c9-b8ce-4851-afdc-bbeb88355160\") " pod="openshift-insights/insights-runtime-extractor-x2m5m" Jul 27 15:58:15.634543 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:15.634505 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:15.689170 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:15.689132 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:15.728171 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:15.728113 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d1324c9-b8ce-4851-afdc-bbeb88355160-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x2m5m\" (UID: \"7d1324c9-b8ce-4851-afdc-bbeb88355160\") " pod="openshift-insights/insights-runtime-extractor-x2m5m" Jul 27 15:58:15.728171 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:15.728170 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d1324c9-b8ce-4851-afdc-bbeb88355160-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x2m5m\" (UID: \"7d1324c9-b8ce-4851-afdc-bbeb88355160\") " pod="openshift-insights/insights-runtime-extractor-x2m5m" Jul 27 15:58:15.728453 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:58:15.728270 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 15:58:15.728453 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:58:15.728295 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 15:58:15.728453 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:58:15.728357 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7d1324c9-b8ce-4851-afdc-bbeb88355160-kube-rbac-proxy-cm podName:7d1324c9-b8ce-4851-afdc-bbeb88355160 nodeName:}" failed. No retries permitted until 2026-07-27 15:58:16.728333514 +0000 UTC m=+267.522059787 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7d1324c9-b8ce-4851-afdc-bbeb88355160-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x2m5m" (UID: "7d1324c9-b8ce-4851-afdc-bbeb88355160") : configmap "kube-rbac-proxy" not found Jul 27 15:58:15.728453 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:58:15.728379 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d1324c9-b8ce-4851-afdc-bbeb88355160-insights-runtime-extractor-tls podName:7d1324c9-b8ce-4851-afdc-bbeb88355160 nodeName:}" failed. No retries permitted until 2026-07-27 15:58:16.728370676 +0000 UTC m=+267.522096948 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7d1324c9-b8ce-4851-afdc-bbeb88355160-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x2m5m" (UID: "7d1324c9-b8ce-4851-afdc-bbeb88355160") : secret "insights-runtime-extractor-tls" not found Jul 27 15:58:16.586399 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:16.586365 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:16.649131 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:16.649080 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:16.736636 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:16.736597 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d1324c9-b8ce-4851-afdc-bbeb88355160-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x2m5m\" (UID: \"7d1324c9-b8ce-4851-afdc-bbeb88355160\") " pod="openshift-insights/insights-runtime-extractor-x2m5m" Jul 27 15:58:16.736824 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:16.736641 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d1324c9-b8ce-4851-afdc-bbeb88355160-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x2m5m\" (UID: \"7d1324c9-b8ce-4851-afdc-bbeb88355160\") " pod="openshift-insights/insights-runtime-extractor-x2m5m" Jul 27 15:58:16.736824 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:58:16.736712 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 15:58:16.736824 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:58:16.736789 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7d1324c9-b8ce-4851-afdc-bbeb88355160-kube-rbac-proxy-cm podName:7d1324c9-b8ce-4851-afdc-bbeb88355160 nodeName:}" failed. No retries permitted until 2026-07-27 15:58:18.73676874 +0000 UTC m=+269.530495021 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7d1324c9-b8ce-4851-afdc-bbeb88355160-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x2m5m" (UID: "7d1324c9-b8ce-4851-afdc-bbeb88355160") : configmap "kube-rbac-proxy" not found Jul 27 15:58:16.736971 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:58:16.736835 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 15:58:16.736971 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:58:16.736894 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d1324c9-b8ce-4851-afdc-bbeb88355160-insights-runtime-extractor-tls podName:7d1324c9-b8ce-4851-afdc-bbeb88355160 nodeName:}" failed. No retries permitted until 2026-07-27 15:58:18.736880825 +0000 UTC m=+269.530607084 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7d1324c9-b8ce-4851-afdc-bbeb88355160-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x2m5m" (UID: "7d1324c9-b8ce-4851-afdc-bbeb88355160") : secret "insights-runtime-extractor-tls" not found Jul 27 15:58:17.517495 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:17.517458 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:18.071565 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:18.071538 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zf9cg_8d8db91e-5711-4fa5-af72-baa451e66451/dns-node-resolver/0.log" Jul 27 15:58:18.667965 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:18.667937 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-62j4b_aadbe564-2de9-44b9-b409-b190bc6f4a26/node-ca/0.log" Jul 27 15:58:18.753149 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:18.753103 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d1324c9-b8ce-4851-afdc-bbeb88355160-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x2m5m\" (UID: \"7d1324c9-b8ce-4851-afdc-bbeb88355160\") " pod="openshift-insights/insights-runtime-extractor-x2m5m" Jul 27 15:58:18.753149 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:18.753155 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d1324c9-b8ce-4851-afdc-bbeb88355160-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x2m5m\" (UID: \"7d1324c9-b8ce-4851-afdc-bbeb88355160\") " pod="openshift-insights/insights-runtime-extractor-x2m5m" Jul 27 15:58:18.753297 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:58:18.753229 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 15:58:18.753297 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:58:18.753275 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 15:58:18.753297 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:58:18.753297 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7d1324c9-b8ce-4851-afdc-bbeb88355160-kube-rbac-proxy-cm podName:7d1324c9-b8ce-4851-afdc-bbeb88355160 nodeName:}" failed. No retries permitted until 2026-07-27 15:58:22.753280264 +0000 UTC m=+273.547006525 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7d1324c9-b8ce-4851-afdc-bbeb88355160-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x2m5m" (UID: "7d1324c9-b8ce-4851-afdc-bbeb88355160") : configmap "kube-rbac-proxy" not found Jul 27 15:58:18.753395 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:58:18.753314 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d1324c9-b8ce-4851-afdc-bbeb88355160-insights-runtime-extractor-tls podName:7d1324c9-b8ce-4851-afdc-bbeb88355160 nodeName:}" failed. No retries permitted until 2026-07-27 15:58:22.753303809 +0000 UTC m=+273.547030065 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7d1324c9-b8ce-4851-afdc-bbeb88355160-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x2m5m" (UID: "7d1324c9-b8ce-4851-afdc-bbeb88355160") : secret "insights-runtime-extractor-tls" not found Jul 27 15:58:19.668784 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:19.668749 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r6vrq_84071b3f-3bb3-4ce6-8309-95cb35d245ad/serve-healthcheck-canary/0.log" Jul 27 15:58:21.223266 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:21.223223 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:21.742357 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:21.742323 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:22.180438 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:22.180406 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:22.279886 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:22.279848 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:22.446252 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:22.446147 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:22.781761 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:22.781648 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d1324c9-b8ce-4851-afdc-bbeb88355160-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x2m5m\" (UID: \"7d1324c9-b8ce-4851-afdc-bbeb88355160\") " pod="openshift-insights/insights-runtime-extractor-x2m5m" Jul 27 15:58:22.781761 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:22.781702 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d1324c9-b8ce-4851-afdc-bbeb88355160-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x2m5m\" (UID: \"7d1324c9-b8ce-4851-afdc-bbeb88355160\") " pod="openshift-insights/insights-runtime-extractor-x2m5m" Jul 27 15:58:22.781974 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:58:22.781786 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 15:58:22.781974 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:58:22.781854 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 15:58:22.781974 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:58:22.781885 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7d1324c9-b8ce-4851-afdc-bbeb88355160-kube-rbac-proxy-cm podName:7d1324c9-b8ce-4851-afdc-bbeb88355160 nodeName:}" failed. No retries permitted until 2026-07-27 15:58:30.781867282 +0000 UTC m=+281.575593561 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7d1324c9-b8ce-4851-afdc-bbeb88355160-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x2m5m" (UID: "7d1324c9-b8ce-4851-afdc-bbeb88355160") : configmap "kube-rbac-proxy" not found Jul 27 15:58:22.781974 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:58:22.781902 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d1324c9-b8ce-4851-afdc-bbeb88355160-insights-runtime-extractor-tls podName:7d1324c9-b8ce-4851-afdc-bbeb88355160 nodeName:}" failed. No retries permitted until 2026-07-27 15:58:30.781895632 +0000 UTC m=+281.575621888 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7d1324c9-b8ce-4851-afdc-bbeb88355160-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x2m5m" (UID: "7d1324c9-b8ce-4851-afdc-bbeb88355160") : secret "insights-runtime-extractor-tls" not found Jul 27 15:58:23.040667 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:23.040570 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:23.451313 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:23.451278 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:23.895532 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:23.895498 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:24.640515 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:24.640481 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:25.043423 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:25.043297 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:25.471340 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:25.471301 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:25.797207 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:25.797177 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:25.895315 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:25.895280 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:26.032196 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:26.032159 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:26.845587 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:26.845554 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:27.042138 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:27.042108 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:27.251171 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:27.251081 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:27.410337 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:27.410307 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:27.470685 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:27.470647 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:27.639944 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:27.639909 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:28.611019 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:28.610977 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:28.837915 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:28.837883 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:28.901341 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:28.901248 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:29.035954 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:29.035923 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:29.553126 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:29.553090 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:29.654777 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:29.654729 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:29.765459 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:29.765423 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:30.812856 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:30.812796 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:30.841927 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:30.841884 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d1324c9-b8ce-4851-afdc-bbeb88355160-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x2m5m\" (UID: \"7d1324c9-b8ce-4851-afdc-bbeb88355160\") " pod="openshift-insights/insights-runtime-extractor-x2m5m" Jul 27 15:58:30.841927 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:30.841929 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d1324c9-b8ce-4851-afdc-bbeb88355160-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x2m5m\" (UID: \"7d1324c9-b8ce-4851-afdc-bbeb88355160\") " pod="openshift-insights/insights-runtime-extractor-x2m5m" Jul 27 15:58:30.842172 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:58:30.842059 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 15:58:30.842172 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:58:30.842128 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d1324c9-b8ce-4851-afdc-bbeb88355160-insights-runtime-extractor-tls podName:7d1324c9-b8ce-4851-afdc-bbeb88355160 nodeName:}" failed. No retries permitted until 2026-07-27 15:58:46.842113976 +0000 UTC m=+297.635840233 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7d1324c9-b8ce-4851-afdc-bbeb88355160-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x2m5m" (UID: "7d1324c9-b8ce-4851-afdc-bbeb88355160") : secret "insights-runtime-extractor-tls" not found Jul 27 15:58:30.842455 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:30.842436 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d1324c9-b8ce-4851-afdc-bbeb88355160-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x2m5m\" (UID: \"7d1324c9-b8ce-4851-afdc-bbeb88355160\") " pod="openshift-insights/insights-runtime-extractor-x2m5m" Jul 27 15:58:31.049575 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:31.049536 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:31.245498 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:31.245406 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:31.634973 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:31.634922 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:31.847139 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:31.847102 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:32.233303 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:32.233259 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:32.432919 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:32.432885 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:33.198344 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:58:33.198284 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-z6kjm" podUID="709e3495-04dc-42d1-bf57-d706479934c3" Jul 27 15:58:33.559715 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:33.559689 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z6kjm" Jul 27 15:58:35.072369 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:35.072325 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:36.024643 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:36.024604 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:36.137729 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:36.137687 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:36.263312 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:36.263270 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:36.561882 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:36.561847 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-7spc6"] Jul 27 15:58:36.565000 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:36.564984 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-7spc6" Jul 27 15:58:36.567551 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:36.567528 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-87rj6\"" Jul 27 15:58:36.567701 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:36.567576 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 27 15:58:36.568375 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:36.568356 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 27 15:58:36.583314 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:36.583286 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/709e3495-04dc-42d1-bf57-d706479934c3-metrics-tls\") pod \"dns-default-z6kjm\" (UID: \"709e3495-04dc-42d1-bf57-d706479934c3\") " pod="openshift-dns/dns-default-z6kjm" Jul 27 15:58:36.584507 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:36.584487 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-7spc6"] Jul 27 15:58:36.585567 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:36.585545 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/709e3495-04dc-42d1-bf57-d706479934c3-metrics-tls\") pod \"dns-default-z6kjm\" (UID: \"709e3495-04dc-42d1-bf57-d706479934c3\") " pod="openshift-dns/dns-default-z6kjm" Jul 27 15:58:36.676453 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:36.676417 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:36.683805 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:36.683781 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tj8f\" (UniqueName: \"kubernetes.io/projected/f3a0a6d1-3acb-4d47-a1b7-670e07c2fc6d-kube-api-access-9tj8f\") pod \"downloads-7c97dc4555-7spc6\" (UID: \"f3a0a6d1-3acb-4d47-a1b7-670e07c2fc6d\") " pod="openshift-console/downloads-7c97dc4555-7spc6" Jul 27 15:58:36.779424 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:36.779387 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:36.784364 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:36.784341 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tj8f\" (UniqueName: \"kubernetes.io/projected/f3a0a6d1-3acb-4d47-a1b7-670e07c2fc6d-kube-api-access-9tj8f\") pod \"downloads-7c97dc4555-7spc6\" (UID: \"f3a0a6d1-3acb-4d47-a1b7-670e07c2fc6d\") " pod="openshift-console/downloads-7c97dc4555-7spc6" Jul 27 15:58:36.798262 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:36.798229 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tj8f\" (UniqueName: \"kubernetes.io/projected/f3a0a6d1-3acb-4d47-a1b7-670e07c2fc6d-kube-api-access-9tj8f\") pod \"downloads-7c97dc4555-7spc6\" (UID: \"f3a0a6d1-3acb-4d47-a1b7-670e07c2fc6d\") " pod="openshift-console/downloads-7c97dc4555-7spc6" Jul 27 15:58:36.862302 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:36.862214 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-grq9c\"" Jul 27 15:58:36.870718 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:36.870698 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z6kjm" Jul 27 15:58:36.874718 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:36.874699 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-7spc6" Jul 27 15:58:37.020141 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:37.017770 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z6kjm"] Jul 27 15:58:37.021347 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:58:37.021320 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod709e3495_04dc_42d1_bf57_d706479934c3.slice/crio-c529dd5097814249dbdac5552d5be3caea6e420bfdbbcc597bfd4884302c0868 WatchSource:0}: Error finding container c529dd5097814249dbdac5552d5be3caea6e420bfdbbcc597bfd4884302c0868: Status 404 returned error can't find the container with id c529dd5097814249dbdac5552d5be3caea6e420bfdbbcc597bfd4884302c0868 Jul 27 15:58:37.027386 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:37.027361 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-7spc6"] Jul 27 15:58:37.030413 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:58:37.030380 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3a0a6d1_3acb_4d47_a1b7_670e07c2fc6d.slice/crio-4a33b9c3117e963828c7d40b50dc1c1371b09976f9f674254dc8be313a4241d5 WatchSource:0}: Error finding container 4a33b9c3117e963828c7d40b50dc1c1371b09976f9f674254dc8be313a4241d5: Status 404 returned error can't find the container with id 4a33b9c3117e963828c7d40b50dc1c1371b09976f9f674254dc8be313a4241d5 Jul 27 15:58:37.573191 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:37.573147 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-7spc6" event={"ID":"f3a0a6d1-3acb-4d47-a1b7-670e07c2fc6d","Type":"ContainerStarted","Data":"4a33b9c3117e963828c7d40b50dc1c1371b09976f9f674254dc8be313a4241d5"} Jul 27 15:58:37.574147 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:37.574128 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z6kjm" event={"ID":"709e3495-04dc-42d1-bf57-d706479934c3","Type":"ContainerStarted","Data":"c529dd5097814249dbdac5552d5be3caea6e420bfdbbcc597bfd4884302c0868"} Jul 27 15:58:37.822015 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:37.821968 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:37.904594 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:37.904508 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:39.585160 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:39.585124 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z6kjm" event={"ID":"709e3495-04dc-42d1-bf57-d706479934c3","Type":"ContainerStarted","Data":"f1f05fabc68314aa78eb55576c91517fb1d9c6cc002fea0fcb140880489884b4"} Jul 27 15:58:39.585576 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:39.585179 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z6kjm" event={"ID":"709e3495-04dc-42d1-bf57-d706479934c3","Type":"ContainerStarted","Data":"f67a6f3b52c3832a82032ee09a04a7d854a33a97a739d6e5f7448d47e25502cd"} Jul 27 15:58:39.585576 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:39.585235 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-z6kjm" Jul 27 15:58:39.602036 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:39.601984 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-z6kjm" podStartSLOduration=251.530699579 podStartE2EDuration="4m13.601966655s" totalImagesPullingTime="2.071267076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:54:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:58:39.601458541 +0000 UTC m=+290.395184836" watchObservedRunningTime="2026-07-27 15:58:39.601966655 +0000 UTC m=+290.395692940" Jul 27 15:58:44.267968 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:44.267922 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:46.870197 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:46.870157 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d1324c9-b8ce-4851-afdc-bbeb88355160-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x2m5m\" (UID: \"7d1324c9-b8ce-4851-afdc-bbeb88355160\") " pod="openshift-insights/insights-runtime-extractor-x2m5m" Jul 27 15:58:46.872953 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:46.872920 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d1324c9-b8ce-4851-afdc-bbeb88355160-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x2m5m\" (UID: \"7d1324c9-b8ce-4851-afdc-bbeb88355160\") " pod="openshift-insights/insights-runtime-extractor-x2m5m" Jul 27 15:58:47.051470 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:47.051422 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:47.164852 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:47.164746 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x2m5m" Jul 27 15:58:48.631809 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:58:48.631748 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-vpk45" podUID="2875ea72-06f8-4c75-b39b-2524b82f6875" Jul 27 15:58:48.838228 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:48.838186 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:48.942270 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:48.942184 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:49.004483 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:49.004445 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:49.592438 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:49.592402 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-z6kjm" Jul 27 15:58:52.748749 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:52.748700 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:53.255674 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:53.255646 2561 kubelet.go:1648] "Image garbage collection succeeded" Jul 27 15:58:53.386519 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:53.386492 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x2m5m"] Jul 27 15:58:53.390886 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:58:53.390856 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d1324c9_b8ce_4851_afdc_bbeb88355160.slice/crio-048f705b0058063b24ca0e084b9dd83561dae8c76aa441d0d795db2683ef1a56 WatchSource:0}: Error finding container 048f705b0058063b24ca0e084b9dd83561dae8c76aa441d0d795db2683ef1a56: Status 404 returned error can't find the container with id 048f705b0058063b24ca0e084b9dd83561dae8c76aa441d0d795db2683ef1a56 Jul 27 15:58:53.392063 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:53.392045 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 27 15:58:53.440563 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:53.440527 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:53.501357 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:53.501279 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:53.637230 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:53.637186 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-7spc6" event={"ID":"f3a0a6d1-3acb-4d47-a1b7-670e07c2fc6d","Type":"ContainerStarted","Data":"a39f2223ae4bbea989330296e02dd097757ca04337361a057945dcc50ae35357"} Jul 27 15:58:53.637426 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:53.637355 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-7spc6" Jul 27 15:58:53.638639 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:53.638602 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x2m5m" event={"ID":"7d1324c9-b8ce-4851-afdc-bbeb88355160","Type":"ContainerStarted","Data":"048f705b0058063b24ca0e084b9dd83561dae8c76aa441d0d795db2683ef1a56"} Jul 27 15:58:53.651035 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:53.651000 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-7spc6" Jul 27 15:58:53.654077 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:53.654021 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-7spc6" podStartSLOduration=1.348189655 podStartE2EDuration="17.653998434s" totalImagesPullingTime="16.305808779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:58:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:58:53.6532327 +0000 UTC m=+304.446958980" watchObservedRunningTime="2026-07-27 15:58:53.653998434 +0000 UTC m=+304.447724764" Jul 27 15:58:54.394458 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:54.394395 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:54.495564 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:54.495488 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:55.000763 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.000718 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:55.147848 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.147748 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:55.252316 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.252235 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:55.267586 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.267332 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-7hmhc"] Jul 27 15:58:55.272528 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.272497 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7hmhc" Jul 27 15:58:55.284662 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.283864 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 27 15:58:55.284662 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.284144 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 27 15:58:55.284662 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.284355 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 27 15:58:55.284662 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.284414 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-jdtj6\"" Jul 27 15:58:55.284662 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.284472 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 27 15:58:55.284662 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.284613 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 27 15:58:55.290625 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.290582 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-49r22"] Jul 27 15:58:55.296381 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.296320 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-7hmhc"] Jul 27 15:58:55.296759 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.296720 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-49r22" Jul 27 15:58:55.304456 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.304193 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 27 15:58:55.304456 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.304447 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 27 15:58:55.306842 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.305622 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 27 15:58:55.313896 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.313835 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-jc5hx\"" Jul 27 15:58:55.340525 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.340443 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:55.443110 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.443037 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48-node-exporter-accelerators-collector-config\") pod \"node-exporter-49r22\" (UID: \"c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48\") " pod="openshift-monitoring/node-exporter-49r22" Jul 27 15:58:55.443110 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.443111 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/59e0da4c-9d6e-4a70-9803-74c95cadd303-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-7hmhc\" (UID: \"59e0da4c-9d6e-4a70-9803-74c95cadd303\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7hmhc" Jul 27 15:58:55.443886 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.443157 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48-node-exporter-tls\") pod \"node-exporter-49r22\" (UID: \"c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48\") " pod="openshift-monitoring/node-exporter-49r22" Jul 27 15:58:55.443886 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.443190 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvvqd\" (UniqueName: \"kubernetes.io/projected/c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48-kube-api-access-dvvqd\") pod \"node-exporter-49r22\" (UID: \"c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48\") " pod="openshift-monitoring/node-exporter-49r22" Jul 27 15:58:55.443886 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.443320 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-49r22\" (UID: \"c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48\") " pod="openshift-monitoring/node-exporter-49r22" Jul 27 15:58:55.443886 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.443356 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwllc\" (UniqueName: \"kubernetes.io/projected/59e0da4c-9d6e-4a70-9803-74c95cadd303-kube-api-access-gwllc\") pod \"openshift-state-metrics-b8f49f5c6-7hmhc\" (UID: \"59e0da4c-9d6e-4a70-9803-74c95cadd303\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7hmhc" Jul 27 15:58:55.443886 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.443405 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48-sys\") pod \"node-exporter-49r22\" (UID: \"c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48\") " pod="openshift-monitoring/node-exporter-49r22" Jul 27 15:58:55.443886 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.443436 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48-root\") pod \"node-exporter-49r22\" (UID: \"c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48\") " pod="openshift-monitoring/node-exporter-49r22" Jul 27 15:58:55.443886 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.443460 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59e0da4c-9d6e-4a70-9803-74c95cadd303-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-7hmhc\" (UID: \"59e0da4c-9d6e-4a70-9803-74c95cadd303\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7hmhc" Jul 27 15:58:55.443886 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.443480 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48-metrics-client-ca\") pod \"node-exporter-49r22\" (UID: \"c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48\") " pod="openshift-monitoring/node-exporter-49r22" Jul 27 15:58:55.443886 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.443503 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48-node-exporter-wtmp\") pod \"node-exporter-49r22\" (UID: \"c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48\") " pod="openshift-monitoring/node-exporter-49r22" Jul 27 15:58:55.443886 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.443554 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59e0da4c-9d6e-4a70-9803-74c95cadd303-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-7hmhc\" (UID: \"59e0da4c-9d6e-4a70-9803-74c95cadd303\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7hmhc" Jul 27 15:58:55.443886 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.443640 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48-node-exporter-textfile\") pod \"node-exporter-49r22\" (UID: \"c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48\") " pod="openshift-monitoring/node-exporter-49r22" Jul 27 15:58:55.444592 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.444167 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:55.542575 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.542464 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:55.544523 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.544486 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-49r22\" (UID: \"c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48\") " pod="openshift-monitoring/node-exporter-49r22" Jul 27 15:58:55.544670 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.544527 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwllc\" (UniqueName: \"kubernetes.io/projected/59e0da4c-9d6e-4a70-9803-74c95cadd303-kube-api-access-gwllc\") pod \"openshift-state-metrics-b8f49f5c6-7hmhc\" (UID: \"59e0da4c-9d6e-4a70-9803-74c95cadd303\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7hmhc" Jul 27 15:58:55.544670 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.544576 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48-sys\") pod \"node-exporter-49r22\" (UID: \"c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48\") " pod="openshift-monitoring/node-exporter-49r22" Jul 27 15:58:55.544670 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.544599 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48-root\") pod \"node-exporter-49r22\" (UID: \"c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48\") " pod="openshift-monitoring/node-exporter-49r22" Jul 27 15:58:55.544670 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.544622 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59e0da4c-9d6e-4a70-9803-74c95cadd303-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-7hmhc\" (UID: \"59e0da4c-9d6e-4a70-9803-74c95cadd303\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7hmhc" Jul 27 15:58:55.544670 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.544653 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48-metrics-client-ca\") pod \"node-exporter-49r22\" (UID: \"c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48\") " pod="openshift-monitoring/node-exporter-49r22" Jul 27 15:58:55.545171 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.544679 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48-node-exporter-wtmp\") pod \"node-exporter-49r22\" (UID: \"c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48\") " pod="openshift-monitoring/node-exporter-49r22" Jul 27 15:58:55.545171 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.544706 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59e0da4c-9d6e-4a70-9803-74c95cadd303-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-7hmhc\" (UID: \"59e0da4c-9d6e-4a70-9803-74c95cadd303\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7hmhc" Jul 27 15:58:55.545171 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.544736 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48-root\") pod \"node-exporter-49r22\" (UID: \"c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48\") " pod="openshift-monitoring/node-exporter-49r22" Jul 27 15:58:55.545171 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.544754 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48-node-exporter-textfile\") pod \"node-exporter-49r22\" (UID: \"c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48\") " pod="openshift-monitoring/node-exporter-49r22" Jul 27 15:58:55.545171 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.544850 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48-node-exporter-accelerators-collector-config\") pod \"node-exporter-49r22\" (UID: \"c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48\") " pod="openshift-monitoring/node-exporter-49r22" Jul 27 15:58:55.545171 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.544895 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/59e0da4c-9d6e-4a70-9803-74c95cadd303-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-7hmhc\" (UID: \"59e0da4c-9d6e-4a70-9803-74c95cadd303\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7hmhc" Jul 27 15:58:55.545171 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.544926 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48-node-exporter-tls\") pod \"node-exporter-49r22\" (UID: \"c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48\") " pod="openshift-monitoring/node-exporter-49r22" Jul 27 15:58:55.545171 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.544958 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvvqd\" (UniqueName: \"kubernetes.io/projected/c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48-kube-api-access-dvvqd\") pod \"node-exporter-49r22\" (UID: \"c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48\") " pod="openshift-monitoring/node-exporter-49r22" Jul 27 15:58:55.545171 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.545097 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48-node-exporter-textfile\") pod \"node-exporter-49r22\" (UID: \"c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48\") " pod="openshift-monitoring/node-exporter-49r22" Jul 27 15:58:55.546010 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.545981 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48-node-exporter-accelerators-collector-config\") pod \"node-exporter-49r22\" (UID: \"c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48\") " pod="openshift-monitoring/node-exporter-49r22" Jul 27 15:58:55.546983 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.546792 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48-metrics-client-ca\") pod \"node-exporter-49r22\" (UID: \"c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48\") " pod="openshift-monitoring/node-exporter-49r22" Jul 27 15:58:55.546983 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.547190 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48-node-exporter-wtmp\") pod \"node-exporter-49r22\" (UID: \"c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48\") " pod="openshift-monitoring/node-exporter-49r22" Jul 27 15:58:55.547731 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.547376 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48-sys\") pod \"node-exporter-49r22\" (UID: \"c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48\") " pod="openshift-monitoring/node-exporter-49r22" Jul 27 15:58:55.547731 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.547711 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59e0da4c-9d6e-4a70-9803-74c95cadd303-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-7hmhc\" (UID: \"59e0da4c-9d6e-4a70-9803-74c95cadd303\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7hmhc" Jul 27 15:58:55.548870 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.548846 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/59e0da4c-9d6e-4a70-9803-74c95cadd303-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-7hmhc\" (UID: \"59e0da4c-9d6e-4a70-9803-74c95cadd303\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7hmhc" Jul 27 15:58:55.550152 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.550105 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48-node-exporter-tls\") pod \"node-exporter-49r22\" (UID: \"c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48\") " pod="openshift-monitoring/node-exporter-49r22" Jul 27 15:58:55.550381 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.550358 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-49r22\" (UID: \"c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48\") " pod="openshift-monitoring/node-exporter-49r22" Jul 27 15:58:55.550861 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.550836 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59e0da4c-9d6e-4a70-9803-74c95cadd303-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-7hmhc\" (UID: \"59e0da4c-9d6e-4a70-9803-74c95cadd303\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7hmhc" Jul 27 15:58:55.557317 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.557287 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwllc\" (UniqueName: \"kubernetes.io/projected/59e0da4c-9d6e-4a70-9803-74c95cadd303-kube-api-access-gwllc\") pod \"openshift-state-metrics-b8f49f5c6-7hmhc\" (UID: \"59e0da4c-9d6e-4a70-9803-74c95cadd303\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7hmhc" Jul 27 15:58:55.563668 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.563604 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvvqd\" (UniqueName: \"kubernetes.io/projected/c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48-kube-api-access-dvvqd\") pod \"node-exporter-49r22\" (UID: \"c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48\") " pod="openshift-monitoring/node-exporter-49r22" Jul 27 15:58:55.587900 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.587853 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7hmhc" Jul 27 15:58:55.610480 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.610452 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-49r22" Jul 27 15:58:55.636623 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.636585 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:55.654747 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:58:55.654717 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8f0eca3_bf2c_4a95_b1ed_dd3c3fe08d48.slice/crio-3efd3449fe967206fa0302ba445ab68aaab92f8b65548e47df589feaed7e1277 WatchSource:0}: Error finding container 3efd3449fe967206fa0302ba445ab68aaab92f8b65548e47df589feaed7e1277: Status 404 returned error can't find the container with id 3efd3449fe967206fa0302ba445ab68aaab92f8b65548e47df589feaed7e1277 Jul 27 15:58:55.743170 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.743126 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:55.791827 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:55.791708 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-7hmhc"] Jul 27 15:58:55.795908 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:58:55.795876 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59e0da4c_9d6e_4a70_9803_74c95cadd303.slice/crio-560f49bbab960a5a6a1f075ea9aa8ce23c5d5963b5f7c0ed698a0b34f4c34be5 WatchSource:0}: Error finding container 560f49bbab960a5a6a1f075ea9aa8ce23c5d5963b5f7c0ed698a0b34f4c34be5: Status 404 returned error can't find the container with id 560f49bbab960a5a6a1f075ea9aa8ce23c5d5963b5f7c0ed698a0b34f4c34be5 Jul 27 15:58:56.394958 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:56.393730 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 27 15:58:56.412889 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:56.411133 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 27 15:58:56.413060 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:56.412909 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 27 15:58:56.414365 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:56.413576 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 27 15:58:56.414365 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:56.413818 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 27 15:58:56.414365 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:56.414256 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 27 15:58:56.414583 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:56.414398 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-l6npr\"" Jul 27 15:58:56.414583 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:56.414471 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 27 15:58:56.414583 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:56.414521 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 27 15:58:56.414583 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:56.414582 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 27 15:58:56.414772 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:56.414255 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 27 15:58:56.414849 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:56.414405 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 27 15:58:56.424132 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:56.424100 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 27 15:58:56.553039 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:56.552993 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/aa3363ff-a6b6-42c8-817c-902048fe0ddb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"aa3363ff-a6b6-42c8-817c-902048fe0ddb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 15:58:56.553516 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:56.553051 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aa3363ff-a6b6-42c8-817c-902048fe0ddb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"aa3363ff-a6b6-42c8-817c-902048fe0ddb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 15:58:56.553516 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:56.553220 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/aa3363ff-a6b6-42c8-817c-902048fe0ddb-config-volume\") pod \"alertmanager-main-0\" (UID: \"aa3363ff-a6b6-42c8-817c-902048fe0ddb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 15:58:56.553516 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:56.553257 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/aa3363ff-a6b6-42c8-817c-902048fe0ddb-web-config\") pod \"alertmanager-main-0\" (UID: \"aa3363ff-a6b6-42c8-817c-902048fe0ddb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 15:58:56.553516 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:56.553340 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/aa3363ff-a6b6-42c8-817c-902048fe0ddb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"aa3363ff-a6b6-42c8-817c-902048fe0ddb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 15:58:56.553516 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:56.553405 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/aa3363ff-a6b6-42c8-817c-902048fe0ddb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"aa3363ff-a6b6-42c8-817c-902048fe0ddb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 15:58:56.553516 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:56.553454 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa3363ff-a6b6-42c8-817c-902048fe0ddb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"aa3363ff-a6b6-42c8-817c-902048fe0ddb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 15:58:56.553516 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:56.553494 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/aa3363ff-a6b6-42c8-817c-902048fe0ddb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"aa3363ff-a6b6-42c8-817c-902048fe0ddb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 15:58:56.553906 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:56.553529 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/aa3363ff-a6b6-42c8-817c-902048fe0ddb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"aa3363ff-a6b6-42c8-817c-902048fe0ddb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 15:58:56.553906 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:56.553555 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h484p\" (UniqueName: \"kubernetes.io/projected/aa3363ff-a6b6-42c8-817c-902048fe0ddb-kube-api-access-h484p\") pod \"alertmanager-main-0\" (UID: \"aa3363ff-a6b6-42c8-817c-902048fe0ddb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 15:58:56.553906 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:56.553607 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/aa3363ff-a6b6-42c8-817c-902048fe0ddb-config-out\") pod \"alertmanager-main-0\" (UID: \"aa3363ff-a6b6-42c8-817c-902048fe0ddb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 15:58:56.553906 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:56.553634 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aa3363ff-a6b6-42c8-817c-902048fe0ddb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"aa3363ff-a6b6-42c8-817c-902048fe0ddb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 15:58:56.553906 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:56.553671 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa3363ff-a6b6-42c8-817c-902048fe0ddb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"aa3363ff-a6b6-42c8-817c-902048fe0ddb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 15:58:56.654740 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:56.654048 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/aa3363ff-a6b6-42c8-817c-902048fe0ddb-config-volume\") pod \"alertmanager-main-0\" (UID: \"aa3363ff-a6b6-42c8-817c-902048fe0ddb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 15:58:56.654740 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:56.654090 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/aa3363ff-a6b6-42c8-817c-902048fe0ddb-web-config\") pod \"alertmanager-main-0\" (UID: \"aa3363ff-a6b6-42c8-817c-902048fe0ddb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 15:58:56.654740 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:56.654128 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/aa3363ff-a6b6-42c8-817c-902048fe0ddb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"aa3363ff-a6b6-42c8-817c-902048fe0ddb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 15:58:56.654740 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:56.654187 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/aa3363ff-a6b6-42c8-817c-902048fe0ddb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"aa3363ff-a6b6-42c8-817c-902048fe0ddb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 15:58:56.654740 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:56.654221 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa3363ff-a6b6-42c8-817c-902048fe0ddb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"aa3363ff-a6b6-42c8-817c-902048fe0ddb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 15:58:56.654740 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:56.654250 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/aa3363ff-a6b6-42c8-817c-902048fe0ddb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"aa3363ff-a6b6-42c8-817c-902048fe0ddb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 15:58:56.654740 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:56.654281 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/aa3363ff-a6b6-42c8-817c-902048fe0ddb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"aa3363ff-a6b6-42c8-817c-902048fe0ddb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 15:58:56.654740 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:56.654301 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h484p\" (UniqueName: \"kubernetes.io/projected/aa3363ff-a6b6-42c8-817c-902048fe0ddb-kube-api-access-h484p\") pod \"alertmanager-main-0\" (UID: \"aa3363ff-a6b6-42c8-817c-902048fe0ddb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 15:58:56.654740 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:56.654720 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/aa3363ff-a6b6-42c8-817c-902048fe0ddb-config-out\") pod \"alertmanager-main-0\" (UID: \"aa3363ff-a6b6-42c8-817c-902048fe0ddb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 15:58:56.655407 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:56.654755 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aa3363ff-a6b6-42c8-817c-902048fe0ddb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"aa3363ff-a6b6-42c8-817c-902048fe0ddb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 15:58:56.655407 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:56.654793 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa3363ff-a6b6-42c8-817c-902048fe0ddb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"aa3363ff-a6b6-42c8-817c-902048fe0ddb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 15:58:56.655407 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:56.654835 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/aa3363ff-a6b6-42c8-817c-902048fe0ddb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"aa3363ff-a6b6-42c8-817c-902048fe0ddb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 15:58:56.655407 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:56.654859 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aa3363ff-a6b6-42c8-817c-902048fe0ddb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"aa3363ff-a6b6-42c8-817c-902048fe0ddb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 15:58:56.655407 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:58:56.655059 2561 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 27 15:58:56.655407 ip-10-0-142-4 kubenswrapper[2561]: E0727 15:58:56.655135 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa3363ff-a6b6-42c8-817c-902048fe0ddb-secret-alertmanager-main-tls podName:aa3363ff-a6b6-42c8-817c-902048fe0ddb nodeName:}" failed. No retries permitted until 2026-07-27 15:58:57.155107707 +0000 UTC m=+307.948833966 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/aa3363ff-a6b6-42c8-817c-902048fe0ddb-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "aa3363ff-a6b6-42c8-817c-902048fe0ddb") : secret "alertmanager-main-tls" not found Jul 27 15:58:56.655695 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:56.655627 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7hmhc" event={"ID":"59e0da4c-9d6e-4a70-9803-74c95cadd303","Type":"ContainerStarted","Data":"a1e1e918088393d9aad9ac53a5027b2e84d87a82c6788223f97523a465dea9ba"} Jul 27 15:58:56.655749 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:56.655695 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7hmhc" event={"ID":"59e0da4c-9d6e-4a70-9803-74c95cadd303","Type":"ContainerStarted","Data":"ac8f651ff6cc1797bda2f0c997cf217405f9cc3f66be6f0c59c440f01fd05f70"} Jul 27 15:58:56.655749 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:56.655727 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7hmhc" event={"ID":"59e0da4c-9d6e-4a70-9803-74c95cadd303","Type":"ContainerStarted","Data":"560f49bbab960a5a6a1f075ea9aa8ce23c5d5963b5f7c0ed698a0b34f4c34be5"} Jul 27 15:58:56.656295 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:56.656269 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa3363ff-a6b6-42c8-817c-902048fe0ddb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"aa3363ff-a6b6-42c8-817c-902048fe0ddb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 15:58:56.656489 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:56.656466 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa3363ff-a6b6-42c8-817c-902048fe0ddb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"aa3363ff-a6b6-42c8-817c-902048fe0ddb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 15:58:56.657722 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:56.657690 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/aa3363ff-a6b6-42c8-817c-902048fe0ddb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"aa3363ff-a6b6-42c8-817c-902048fe0ddb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 15:58:56.659718 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:56.659612 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-49r22" event={"ID":"c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48","Type":"ContainerStarted","Data":"3efd3449fe967206fa0302ba445ab68aaab92f8b65548e47df589feaed7e1277"} Jul 27 15:58:56.662293 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:56.662267 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/aa3363ff-a6b6-42c8-817c-902048fe0ddb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"aa3363ff-a6b6-42c8-817c-902048fe0ddb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 15:58:56.662999 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:56.662656 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/aa3363ff-a6b6-42c8-817c-902048fe0ddb-config-volume\") pod \"alertmanager-main-0\" (UID: \"aa3363ff-a6b6-42c8-817c-902048fe0ddb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 15:58:56.662999 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:56.662888 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aa3363ff-a6b6-42c8-817c-902048fe0ddb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"aa3363ff-a6b6-42c8-817c-902048fe0ddb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 15:58:56.662999 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:56.662956 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aa3363ff-a6b6-42c8-817c-902048fe0ddb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"aa3363ff-a6b6-42c8-817c-902048fe0ddb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 15:58:56.663405 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:56.663381 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/aa3363ff-a6b6-42c8-817c-902048fe0ddb-web-config\") pod \"alertmanager-main-0\" (UID: \"aa3363ff-a6b6-42c8-817c-902048fe0ddb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 15:58:56.663730 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:56.663686 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/aa3363ff-a6b6-42c8-817c-902048fe0ddb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"aa3363ff-a6b6-42c8-817c-902048fe0ddb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 15:58:56.664949 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:56.664923 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/aa3363ff-a6b6-42c8-817c-902048fe0ddb-config-out\") pod \"alertmanager-main-0\" (UID: \"aa3363ff-a6b6-42c8-817c-902048fe0ddb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 15:58:56.665307 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:56.665288 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/aa3363ff-a6b6-42c8-817c-902048fe0ddb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"aa3363ff-a6b6-42c8-817c-902048fe0ddb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 15:58:56.668273 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:56.668250 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h484p\" (UniqueName: \"kubernetes.io/projected/aa3363ff-a6b6-42c8-817c-902048fe0ddb-kube-api-access-h484p\") pod \"alertmanager-main-0\" (UID: \"aa3363ff-a6b6-42c8-817c-902048fe0ddb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 15:58:57.073503 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:57.073459 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:57.158548 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:57.158449 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/aa3363ff-a6b6-42c8-817c-902048fe0ddb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"aa3363ff-a6b6-42c8-817c-902048fe0ddb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 15:58:57.161987 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:57.161733 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/aa3363ff-a6b6-42c8-817c-902048fe0ddb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"aa3363ff-a6b6-42c8-817c-902048fe0ddb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 15:58:57.175129 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:57.175069 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:57.309504 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:57.309460 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-68c99b9449-k5x67"] Jul 27 15:58:57.329554 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:57.329282 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 27 15:58:57.335561 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:57.334056 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-68c99b9449-k5x67"] Jul 27 15:58:57.335561 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:57.334189 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-68c99b9449-k5x67" Jul 27 15:58:57.336682 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:57.336652 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 27 15:58:57.337099 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:57.337012 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 27 15:58:57.337281 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:57.337254 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-pcbcq\"" Jul 27 15:58:57.337716 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:57.337695 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-big41gpqcvr80\"" Jul 27 15:58:57.338006 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:57.337982 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 27 15:58:57.338217 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:57.338196 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 27 15:58:57.338436 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:57.338419 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 27 15:58:57.360350 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:57.360286 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6msz\" (UniqueName: \"kubernetes.io/projected/8ddb09a2-fc83-43d5-8e99-414dd6cda85e-kube-api-access-m6msz\") pod \"thanos-querier-68c99b9449-k5x67\" (UID: \"8ddb09a2-fc83-43d5-8e99-414dd6cda85e\") " pod="openshift-monitoring/thanos-querier-68c99b9449-k5x67" Jul 27 15:58:57.360493 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:57.360351 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8ddb09a2-fc83-43d5-8e99-414dd6cda85e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-68c99b9449-k5x67\" (UID: \"8ddb09a2-fc83-43d5-8e99-414dd6cda85e\") " pod="openshift-monitoring/thanos-querier-68c99b9449-k5x67" Jul 27 15:58:57.360493 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:57.360430 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8ddb09a2-fc83-43d5-8e99-414dd6cda85e-secret-grpc-tls\") pod \"thanos-querier-68c99b9449-k5x67\" (UID: \"8ddb09a2-fc83-43d5-8e99-414dd6cda85e\") " pod="openshift-monitoring/thanos-querier-68c99b9449-k5x67" Jul 27 15:58:57.360617 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:57.360502 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8ddb09a2-fc83-43d5-8e99-414dd6cda85e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-68c99b9449-k5x67\" (UID: \"8ddb09a2-fc83-43d5-8e99-414dd6cda85e\") " pod="openshift-monitoring/thanos-querier-68c99b9449-k5x67" Jul 27 15:58:57.360617 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:57.360577 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8ddb09a2-fc83-43d5-8e99-414dd6cda85e-secret-thanos-querier-tls\") pod \"thanos-querier-68c99b9449-k5x67\" (UID: \"8ddb09a2-fc83-43d5-8e99-414dd6cda85e\") " pod="openshift-monitoring/thanos-querier-68c99b9449-k5x67" Jul 27 15:58:57.360617 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:57.360605 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8ddb09a2-fc83-43d5-8e99-414dd6cda85e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-68c99b9449-k5x67\" (UID: \"8ddb09a2-fc83-43d5-8e99-414dd6cda85e\") " pod="openshift-monitoring/thanos-querier-68c99b9449-k5x67" Jul 27 15:58:57.360754 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:57.360644 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ddb09a2-fc83-43d5-8e99-414dd6cda85e-metrics-client-ca\") pod \"thanos-querier-68c99b9449-k5x67\" (UID: \"8ddb09a2-fc83-43d5-8e99-414dd6cda85e\") " pod="openshift-monitoring/thanos-querier-68c99b9449-k5x67" Jul 27 15:58:57.360754 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:57.360673 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8ddb09a2-fc83-43d5-8e99-414dd6cda85e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-68c99b9449-k5x67\" (UID: \"8ddb09a2-fc83-43d5-8e99-414dd6cda85e\") " pod="openshift-monitoring/thanos-querier-68c99b9449-k5x67" Jul 27 15:58:57.461727 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:57.461477 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8ddb09a2-fc83-43d5-8e99-414dd6cda85e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-68c99b9449-k5x67\" (UID: \"8ddb09a2-fc83-43d5-8e99-414dd6cda85e\") " pod="openshift-monitoring/thanos-querier-68c99b9449-k5x67" Jul 27 15:58:57.461727 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:57.461527 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6msz\" (UniqueName: \"kubernetes.io/projected/8ddb09a2-fc83-43d5-8e99-414dd6cda85e-kube-api-access-m6msz\") pod \"thanos-querier-68c99b9449-k5x67\" (UID: \"8ddb09a2-fc83-43d5-8e99-414dd6cda85e\") " pod="openshift-monitoring/thanos-querier-68c99b9449-k5x67" Jul 27 15:58:57.461727 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:57.461567 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8ddb09a2-fc83-43d5-8e99-414dd6cda85e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-68c99b9449-k5x67\" (UID: \"8ddb09a2-fc83-43d5-8e99-414dd6cda85e\") " pod="openshift-monitoring/thanos-querier-68c99b9449-k5x67" Jul 27 15:58:57.461727 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:57.461601 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8ddb09a2-fc83-43d5-8e99-414dd6cda85e-secret-grpc-tls\") pod \"thanos-querier-68c99b9449-k5x67\" (UID: \"8ddb09a2-fc83-43d5-8e99-414dd6cda85e\") " pod="openshift-monitoring/thanos-querier-68c99b9449-k5x67" Jul 27 15:58:57.461727 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:57.461643 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8ddb09a2-fc83-43d5-8e99-414dd6cda85e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-68c99b9449-k5x67\" (UID: \"8ddb09a2-fc83-43d5-8e99-414dd6cda85e\") " pod="openshift-monitoring/thanos-querier-68c99b9449-k5x67" Jul 27 15:58:57.462142 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:57.462107 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8ddb09a2-fc83-43d5-8e99-414dd6cda85e-secret-thanos-querier-tls\") pod \"thanos-querier-68c99b9449-k5x67\" (UID: \"8ddb09a2-fc83-43d5-8e99-414dd6cda85e\") " pod="openshift-monitoring/thanos-querier-68c99b9449-k5x67" Jul 27 15:58:57.462196 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:57.462156 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8ddb09a2-fc83-43d5-8e99-414dd6cda85e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-68c99b9449-k5x67\" (UID: \"8ddb09a2-fc83-43d5-8e99-414dd6cda85e\") " pod="openshift-monitoring/thanos-querier-68c99b9449-k5x67" Jul 27 15:58:57.464008 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:57.462885 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ddb09a2-fc83-43d5-8e99-414dd6cda85e-metrics-client-ca\") pod \"thanos-querier-68c99b9449-k5x67\" (UID: \"8ddb09a2-fc83-43d5-8e99-414dd6cda85e\") " pod="openshift-monitoring/thanos-querier-68c99b9449-k5x67" Jul 27 15:58:57.464008 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:57.463670 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ddb09a2-fc83-43d5-8e99-414dd6cda85e-metrics-client-ca\") pod \"thanos-querier-68c99b9449-k5x67\" (UID: \"8ddb09a2-fc83-43d5-8e99-414dd6cda85e\") " pod="openshift-monitoring/thanos-querier-68c99b9449-k5x67" Jul 27 15:58:57.466522 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:57.466492 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8ddb09a2-fc83-43d5-8e99-414dd6cda85e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-68c99b9449-k5x67\" (UID: \"8ddb09a2-fc83-43d5-8e99-414dd6cda85e\") " pod="openshift-monitoring/thanos-querier-68c99b9449-k5x67" Jul 27 15:58:57.468768 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:57.468616 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8ddb09a2-fc83-43d5-8e99-414dd6cda85e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-68c99b9449-k5x67\" (UID: \"8ddb09a2-fc83-43d5-8e99-414dd6cda85e\") " pod="openshift-monitoring/thanos-querier-68c99b9449-k5x67" Jul 27 15:58:57.468768 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:57.468726 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8ddb09a2-fc83-43d5-8e99-414dd6cda85e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-68c99b9449-k5x67\" (UID: \"8ddb09a2-fc83-43d5-8e99-414dd6cda85e\") " pod="openshift-monitoring/thanos-querier-68c99b9449-k5x67" Jul 27 15:58:57.469978 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:57.469938 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8ddb09a2-fc83-43d5-8e99-414dd6cda85e-secret-grpc-tls\") pod \"thanos-querier-68c99b9449-k5x67\" (UID: \"8ddb09a2-fc83-43d5-8e99-414dd6cda85e\") " pod="openshift-monitoring/thanos-querier-68c99b9449-k5x67" Jul 27 15:58:57.470955 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:57.470473 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8ddb09a2-fc83-43d5-8e99-414dd6cda85e-secret-thanos-querier-tls\") pod \"thanos-querier-68c99b9449-k5x67\" (UID: \"8ddb09a2-fc83-43d5-8e99-414dd6cda85e\") " pod="openshift-monitoring/thanos-querier-68c99b9449-k5x67" Jul 27 15:58:57.471773 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:57.471731 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8ddb09a2-fc83-43d5-8e99-414dd6cda85e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-68c99b9449-k5x67\" (UID: \"8ddb09a2-fc83-43d5-8e99-414dd6cda85e\") " pod="openshift-monitoring/thanos-querier-68c99b9449-k5x67" Jul 27 15:58:57.473394 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:57.473370 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6msz\" (UniqueName: \"kubernetes.io/projected/8ddb09a2-fc83-43d5-8e99-414dd6cda85e-kube-api-access-m6msz\") pod \"thanos-querier-68c99b9449-k5x67\" (UID: \"8ddb09a2-fc83-43d5-8e99-414dd6cda85e\") " pod="openshift-monitoring/thanos-querier-68c99b9449-k5x67" Jul 27 15:58:57.650179 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:57.650089 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-68c99b9449-k5x67" Jul 27 15:58:57.663001 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:57.662948 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:57.764085 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:57.764043 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:58.297908 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:58.297874 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:58.516462 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:58.516428 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:58.578467 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:58.578386 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:58.810280 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:58.810183 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:58.875622 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:58.875462 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:59.197349 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:59.197265 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:58:59.298272 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:58:59.298229 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:59:00.044292 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:00.044253 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:59:00.108495 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:00.108436 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:59:00.329193 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:00.329122 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8548b87658-7dpf8" podUID="fcf0201b-e45d-44e4-af67-a3f24cb6e1a4" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 27 15:59:00.596232 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:00.596109 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:59:01.114293 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:01.114227 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-68c99b9449-k5x67"] Jul 27 15:59:01.117632 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:59:01.117596 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ddb09a2_fc83_43d5_8e99_414dd6cda85e.slice/crio-3e189403707be884a07d6b511f54ccda8994e26204e0a5e221144d13b2b4c916 WatchSource:0}: Error finding container 3e189403707be884a07d6b511f54ccda8994e26204e0a5e221144d13b2b4c916: Status 404 returned error can't find the container with id 3e189403707be884a07d6b511f54ccda8994e26204e0a5e221144d13b2b4c916 Jul 27 15:59:01.135562 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:01.135527 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 27 15:59:01.140188 ip-10-0-142-4 kubenswrapper[2561]: W0727 15:59:01.140158 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa3363ff_a6b6_42c8_817c_902048fe0ddb.slice/crio-698f5b9e628f0db8e57a34e074054f21b4d5bceb4e8a229d464b18fda75094e5 WatchSource:0}: Error finding container 698f5b9e628f0db8e57a34e074054f21b4d5bceb4e8a229d464b18fda75094e5: Status 404 returned error can't find the container with id 698f5b9e628f0db8e57a34e074054f21b4d5bceb4e8a229d464b18fda75094e5 Jul 27 15:59:01.490256 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:01.490085 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:59:01.588824 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:01.588765 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:59:01.666949 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:01.666913 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:59:01.681851 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:01.681790 2561 generic.go:356] "Generic (PLEG): container finished" podID="c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48" containerID="e46480ec6d757016f6d461d1c71466cee3e32f95974ee96b586612e4fb243df8" exitCode=0 Jul 27 15:59:01.681851 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:01.681835 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-49r22" event={"ID":"c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48","Type":"ContainerDied","Data":"e46480ec6d757016f6d461d1c71466cee3e32f95974ee96b586612e4fb243df8"} Jul 27 15:59:01.683443 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:01.683418 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aa3363ff-a6b6-42c8-817c-902048fe0ddb","Type":"ContainerStarted","Data":"698f5b9e628f0db8e57a34e074054f21b4d5bceb4e8a229d464b18fda75094e5"} Jul 27 15:59:01.684785 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:01.684753 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68c99b9449-k5x67" event={"ID":"8ddb09a2-fc83-43d5-8e99-414dd6cda85e","Type":"ContainerStarted","Data":"3e189403707be884a07d6b511f54ccda8994e26204e0a5e221144d13b2b4c916"} Jul 27 15:59:02.698830 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:02.698566 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7hmhc" event={"ID":"59e0da4c-9d6e-4a70-9803-74c95cadd303","Type":"ContainerStarted","Data":"6766f7d750b1c3644b95a9061d75bb08a99b51599c222157f09f31e5947d4f29"} Jul 27 15:59:02.707419 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:02.707352 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x2m5m" event={"ID":"7d1324c9-b8ce-4851-afdc-bbeb88355160","Type":"ContainerStarted","Data":"321e401e9e79c3011da61d7e39b1fc6ceb0fb1c83f256817ef89a0c96b8c791a"} Jul 27 15:59:02.711822 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:02.710783 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-49r22" event={"ID":"c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48","Type":"ContainerStarted","Data":"4a8945e6bad6e52b37639ff6fcb5f251cf3ef2f2f7f86e6c4c8e54da6bab4acb"} Jul 27 15:59:02.711822 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:02.710896 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-49r22" event={"ID":"c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48","Type":"ContainerStarted","Data":"eab9cfb31c705f759b00a73a07fa32f7c5365074ac35da8002d5587a8b31599e"} Jul 27 15:59:02.716412 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:02.716058 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7hmhc" podStartSLOduration=1.6374355010000001 podStartE2EDuration="7.716038826s" totalImagesPullingTime="6.078603325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:58:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:59:02.715773661 +0000 UTC m=+313.509499953" watchObservedRunningTime="2026-07-27 15:59:02.716038826 +0000 UTC m=+313.509765105" Jul 27 15:59:02.737243 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:02.736726 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-49r22" podStartSLOduration=2.347167068 podStartE2EDuration="7.736701261s" totalImagesPullingTime="5.282279475s" totalInitContainerRuntime="107.254718ms" isStatefulPod=true podCreationTimestamp="2026-07-27 15:58:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:59:02.735463312 +0000 UTC m=+313.529189593" watchObservedRunningTime="2026-07-27 15:59:02.736701261 +0000 UTC m=+313.530427545" Jul 27 15:59:03.630882 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:03.630846 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vpk45" Jul 27 15:59:04.795265 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:04.795227 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:59:04.880950 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:04.880906 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:59:07.736033 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:07.735935 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x2m5m" event={"ID":"7d1324c9-b8ce-4851-afdc-bbeb88355160","Type":"ContainerStarted","Data":"4da5a170da7ba7b967ecc52b64e4b379888709315654a0b893c853ed761ca040"} Jul 27 15:59:07.737432 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:07.737399 2561 generic.go:356] "Generic (PLEG): container finished" podID="aa3363ff-a6b6-42c8-817c-902048fe0ddb" containerID="9ab0b713818f6c1024fbdef89c526a5eb00cd8919de2b0baf59af2720d307e5e" exitCode=0 Jul 27 15:59:07.737657 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:07.737478 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aa3363ff-a6b6-42c8-817c-902048fe0ddb","Type":"ContainerDied","Data":"9ab0b713818f6c1024fbdef89c526a5eb00cd8919de2b0baf59af2720d307e5e"} Jul 27 15:59:07.739671 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:07.739650 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68c99b9449-k5x67" event={"ID":"8ddb09a2-fc83-43d5-8e99-414dd6cda85e","Type":"ContainerStarted","Data":"82e62b2132e31485b5cdbc659becf619193d026773f3c36c82626fae3672f210"} Jul 27 15:59:07.739756 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:07.739709 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68c99b9449-k5x67" event={"ID":"8ddb09a2-fc83-43d5-8e99-414dd6cda85e","Type":"ContainerStarted","Data":"625e2fff135b3145bbe892ee1d28b6a006be96a34a8e2d30530c6d71c7e3e542"} Jul 27 15:59:07.739756 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:07.739739 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68c99b9449-k5x67" event={"ID":"8ddb09a2-fc83-43d5-8e99-414dd6cda85e","Type":"ContainerStarted","Data":"f3201942bd8f0df63edd24fa893f268c238c11fd5f1051ed3b4bf38bab9d2251"} Jul 27 15:59:07.995733 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:07.995639 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:59:08.097010 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:08.096968 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:59:09.754250 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:09.754157 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68c99b9449-k5x67" event={"ID":"8ddb09a2-fc83-43d5-8e99-414dd6cda85e","Type":"ContainerStarted","Data":"44a7c5b35a817122f418280e987e7c51925390a199f829c3a5badeec0933443b"} Jul 27 15:59:09.754787 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:09.754251 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68c99b9449-k5x67" event={"ID":"8ddb09a2-fc83-43d5-8e99-414dd6cda85e","Type":"ContainerStarted","Data":"0ef2b59829deac1db2a75508a76ec414e7b004b81985cd1c08b5d50bf49e677d"} Jul 27 15:59:09.754787 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:09.754292 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68c99b9449-k5x67" event={"ID":"8ddb09a2-fc83-43d5-8e99-414dd6cda85e","Type":"ContainerStarted","Data":"b30edd150128497899e4d263e2ae8b7847bb77327114a1368a0dabd2e62f6d6e"} Jul 27 15:59:09.754787 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:09.754378 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-68c99b9449-k5x67" Jul 27 15:59:09.781172 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:09.781117 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-68c99b9449-k5x67" podStartSLOduration=5.334614686 podStartE2EDuration="12.781100626s" totalImagesPullingTime="7.44648594s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:58:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:59:09.78028914 +0000 UTC m=+320.574015418" watchObservedRunningTime="2026-07-27 15:59:09.781100626 +0000 UTC m=+320.574826905" Jul 27 15:59:10.330650 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:10.330598 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8548b87658-7dpf8" podUID="fcf0201b-e45d-44e4-af67-a3f24cb6e1a4" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 27 15:59:11.818758 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:11.818709 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:59:11.873287 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:11.873236 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:59:12.771214 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:12.771179 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aa3363ff-a6b6-42c8-817c-902048fe0ddb","Type":"ContainerStarted","Data":"39568a3913117157fe7def234b92da64dcb6b7031c6d58114b6554a5e8a60a32"} Jul 27 15:59:12.771331 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:12.771273 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aa3363ff-a6b6-42c8-817c-902048fe0ddb","Type":"ContainerStarted","Data":"383a1c1c3ff0523217d8cde6f5fefa42df70401c0b760b0373daaaa178d53135"} Jul 27 15:59:12.771331 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:12.771320 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aa3363ff-a6b6-42c8-817c-902048fe0ddb","Type":"ContainerStarted","Data":"646ff9e8bd2eb0e16179b9f2d3203e0d35c1714f4f833d0bad43274bb856890d"} Jul 27 15:59:12.771439 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:12.771355 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aa3363ff-a6b6-42c8-817c-902048fe0ddb","Type":"ContainerStarted","Data":"bee9e9d56901f14f2f194951fd466bbfa3a2529456859f24edf2bc200620d73f"} Jul 27 15:59:12.773304 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:12.773279 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x2m5m" event={"ID":"7d1324c9-b8ce-4851-afdc-bbeb88355160","Type":"ContainerStarted","Data":"29650ca5e4be5a653481147fb12a93a45f38fa42a1c7f05ab48e7a02afb3a1ea"} Jul 27 15:59:12.793143 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:12.793097 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-x2m5m" podStartSLOduration=39.152777812 podStartE2EDuration="57.793079248s" totalImagesPullingTime="18.640301436s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 15:58:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:59:12.791736389 +0000 UTC m=+323.585462668" watchObservedRunningTime="2026-07-27 15:59:12.793079248 +0000 UTC m=+323.586805527" Jul 27 15:59:13.780918 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:13.780861 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aa3363ff-a6b6-42c8-817c-902048fe0ddb","Type":"ContainerStarted","Data":"9947e463c7a28548ecec717b68a98606d455c415699df58054ca0d49455b5e86"} Jul 27 15:59:13.781461 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:13.780963 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aa3363ff-a6b6-42c8-817c-902048fe0ddb","Type":"ContainerStarted","Data":"46f7b569ab0215c991ad7b0451b293976c6d1691c589e2f814579ea8de7d6235"} Jul 27 15:59:13.809184 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:13.809123 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=7.494892138 podStartE2EDuration="17.809106573s" totalImagesPullingTime="10.302237595s" totalInitContainerRuntime="11.97684ms" isStatefulPod=false podCreationTimestamp="2026-07-27 15:58:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:59:13.807537392 +0000 UTC m=+324.601263671" watchObservedRunningTime="2026-07-27 15:59:13.809106573 +0000 UTC m=+324.602832852" Jul 27 15:59:14.116771 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:14.116736 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:59:14.217493 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:14.217457 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:59:14.348740 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:14.348703 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:59:15.766570 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:15.766542 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-68c99b9449-k5x67" Jul 27 15:59:16.858820 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:16.858759 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:59:17.586285 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:17.586248 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:59:17.683237 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:17.683196 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:59:17.882589 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:17.882495 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:59:20.209519 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:20.209481 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r6vrq_84071b3f-3bb3-4ce6-8309-95cb35d245ad/serve-healthcheck-canary/0.log" Jul 27 15:59:20.327743 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:20.327702 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8548b87658-7dpf8" podUID="fcf0201b-e45d-44e4-af67-a3f24cb6e1a4" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 27 15:59:20.327944 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:20.327771 2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8548b87658-7dpf8" Jul 27 15:59:20.328288 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:20.328256 2561 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"d4dbf0da15470637f3e288b6dc2451bc8a453850279eb7cb0f30a3741b0c7a48"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8548b87658-7dpf8" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jul 27 15:59:20.328325 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:20.328310 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8548b87658-7dpf8" podUID="fcf0201b-e45d-44e4-af67-a3f24cb6e1a4" containerName="service-proxy" containerID="cri-o://d4dbf0da15470637f3e288b6dc2451bc8a453850279eb7cb0f30a3741b0c7a48" gracePeriod=30 Jul 27 15:59:20.811564 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:20.811528 2561 generic.go:356] "Generic (PLEG): container finished" podID="fcf0201b-e45d-44e4-af67-a3f24cb6e1a4" containerID="d4dbf0da15470637f3e288b6dc2451bc8a453850279eb7cb0f30a3741b0c7a48" exitCode=2 Jul 27 15:59:20.811748 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:20.811602 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8548b87658-7dpf8" event={"ID":"fcf0201b-e45d-44e4-af67-a3f24cb6e1a4","Type":"ContainerDied","Data":"d4dbf0da15470637f3e288b6dc2451bc8a453850279eb7cb0f30a3741b0c7a48"} Jul 27 15:59:20.888051 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:20.887992 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:59:20.989607 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:20.989572 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:59:21.818594 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:21.818557 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8548b87658-7dpf8" event={"ID":"fcf0201b-e45d-44e4-af67-a3f24cb6e1a4","Type":"ContainerStarted","Data":"23b468381d0f44c0ea44b81f7a919b4c4f5e0747dabc35599cdb3811089574c8"} Jul 27 15:59:23.864901 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:23.864849 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:59:23.965437 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:23.965396 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:59:29.201518 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:29.201484 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:59:29.298628 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:29.298594 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:59:44.198485 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:44.198395 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 15:59:44.275137 ip-10-0-142-4 kubenswrapper[2561]: I0727 15:59:44.275085 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:00:03.459215 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:00:03.459170 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2875ea72-06f8-4c75-b39b-2524b82f6875-metrics-certs\") pod \"network-metrics-daemon-vpk45\" (UID: \"2875ea72-06f8-4c75-b39b-2524b82f6875\") " pod="openshift-multus/network-metrics-daemon-vpk45" Jul 27 16:00:03.461614 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:00:03.461585 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2875ea72-06f8-4c75-b39b-2524b82f6875-metrics-certs\") pod \"network-metrics-daemon-vpk45\" (UID: \"2875ea72-06f8-4c75-b39b-2524b82f6875\") " pod="openshift-multus/network-metrics-daemon-vpk45" Jul 27 16:00:03.633761 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:00:03.633724 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8zjp2\"" Jul 27 16:00:03.642423 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:00:03.642394 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vpk45" Jul 27 16:00:03.780970 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:00:03.780939 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vpk45"] Jul 27 16:00:03.784776 ip-10-0-142-4 kubenswrapper[2561]: W0727 16:00:03.784744 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2875ea72_06f8_4c75_b39b_2524b82f6875.slice/crio-d3a7963dde22658bf399b98b3e99a334074e81e45c5fbb1f35a6dccf06bc375a WatchSource:0}: Error finding container d3a7963dde22658bf399b98b3e99a334074e81e45c5fbb1f35a6dccf06bc375a: Status 404 returned error can't find the container with id d3a7963dde22658bf399b98b3e99a334074e81e45c5fbb1f35a6dccf06bc375a Jul 27 16:00:03.977067 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:00:03.977031 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vpk45" event={"ID":"2875ea72-06f8-4c75-b39b-2524b82f6875","Type":"ContainerStarted","Data":"d3a7963dde22658bf399b98b3e99a334074e81e45c5fbb1f35a6dccf06bc375a"} Jul 27 16:00:06.994430 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:00:06.994385 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vpk45" event={"ID":"2875ea72-06f8-4c75-b39b-2524b82f6875","Type":"ContainerStarted","Data":"5c57ca2e10a40c03a3ffc036d6fab9281a67ed950840813032fed8d02b9897b4"} Jul 27 16:00:06.994859 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:00:06.994479 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vpk45" event={"ID":"2875ea72-06f8-4c75-b39b-2524b82f6875","Type":"ContainerStarted","Data":"4dcc6d431493d566f882c9cb1bd49e641998497762380567c0a8e3e385cc46f7"} Jul 27 16:00:07.011153 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:00:07.011096 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vpk45" podStartSLOduration=374.817879055 podStartE2EDuration="6m17.011080116s" totalImagesPullingTime="2.193201061s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:53:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:00:07.009926333 +0000 UTC m=+377.803652628" watchObservedRunningTime="2026-07-27 16:00:07.011080116 +0000 UTC m=+377.804806394" Jul 27 16:00:07.114099 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:00:07.114061 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:00:07.180106 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:00:07.180066 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:00:08.660595 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:00:08.660557 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:00:08.759959 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:00:08.759926 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:00:11.535662 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:00:11.535622 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:00:11.608933 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:00:11.608892 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:00:17.587595 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:00:17.587558 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:00:17.679608 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:00:17.679572 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:00:19.766833 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:00:19.766780 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:00:19.830087 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:00:19.830048 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:00:23.509563 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:00:23.509473 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:00:23.610611 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:00:23.610573 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:00:28.963071 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:00:28.963038 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:00:29.080615 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:00:29.080572 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:00:29.700571 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:00:29.700537 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:00:29.781291 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:00:29.781255 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:00:33.960354 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:00:33.960312 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:00:50.891822 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:00:50.891776 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:00:50.949037 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:00:50.949000 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:01:11.095263 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:01:11.095225 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:01:28.675202 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:01:28.675144 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:01:28.764148 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:01:28.764100 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:01:30.054638 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:01:30.054606 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lv7ql"] Jul 27 16:01:30.057917 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:01:30.057899 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lv7ql" Jul 27 16:01:30.060548 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:01:30.060524 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 27 16:01:30.060771 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:01:30.060750 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-q7q78\"" Jul 27 16:01:30.061046 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:01:30.061030 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 27 16:01:30.071973 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:01:30.071945 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a1c9bc9-419e-4cdf-a105-0de7ae8815c3-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lv7ql\" (UID: \"4a1c9bc9-419e-4cdf-a105-0de7ae8815c3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lv7ql" Jul 27 16:01:30.072088 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:01:30.071989 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a1c9bc9-419e-4cdf-a105-0de7ae8815c3-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lv7ql\" (UID: \"4a1c9bc9-419e-4cdf-a105-0de7ae8815c3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lv7ql" Jul 27 16:01:30.072088 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:01:30.072021 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8c2m\" (UniqueName: \"kubernetes.io/projected/4a1c9bc9-419e-4cdf-a105-0de7ae8815c3-kube-api-access-b8c2m\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lv7ql\" (UID: \"4a1c9bc9-419e-4cdf-a105-0de7ae8815c3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lv7ql" Jul 27 16:01:30.074452 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:01:30.074427 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lv7ql"] Jul 27 16:01:30.172522 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:01:30.172483 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8c2m\" (UniqueName: \"kubernetes.io/projected/4a1c9bc9-419e-4cdf-a105-0de7ae8815c3-kube-api-access-b8c2m\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lv7ql\" (UID: \"4a1c9bc9-419e-4cdf-a105-0de7ae8815c3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lv7ql" Jul 27 16:01:30.172736 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:01:30.172567 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a1c9bc9-419e-4cdf-a105-0de7ae8815c3-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lv7ql\" (UID: \"4a1c9bc9-419e-4cdf-a105-0de7ae8815c3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lv7ql" Jul 27 16:01:30.172736 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:01:30.172604 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a1c9bc9-419e-4cdf-a105-0de7ae8815c3-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lv7ql\" (UID: \"4a1c9bc9-419e-4cdf-a105-0de7ae8815c3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lv7ql" Jul 27 16:01:30.173033 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:01:30.173013 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a1c9bc9-419e-4cdf-a105-0de7ae8815c3-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lv7ql\" (UID: \"4a1c9bc9-419e-4cdf-a105-0de7ae8815c3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lv7ql" Jul 27 16:01:30.173101 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:01:30.173049 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a1c9bc9-419e-4cdf-a105-0de7ae8815c3-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lv7ql\" (UID: \"4a1c9bc9-419e-4cdf-a105-0de7ae8815c3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lv7ql" Jul 27 16:01:30.182055 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:01:30.182035 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8c2m\" (UniqueName: \"kubernetes.io/projected/4a1c9bc9-419e-4cdf-a105-0de7ae8815c3-kube-api-access-b8c2m\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lv7ql\" (UID: \"4a1c9bc9-419e-4cdf-a105-0de7ae8815c3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lv7ql" Jul 27 16:01:30.366690 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:01:30.366602 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lv7ql" Jul 27 16:01:30.510240 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:01:30.510105 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lv7ql"] Jul 27 16:01:30.512953 ip-10-0-142-4 kubenswrapper[2561]: W0727 16:01:30.512922 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a1c9bc9_419e_4cdf_a105_0de7ae8815c3.slice/crio-efa7155be81904f39efe7de1ec3e26cda983bd04d2f343a9549ca6431e82aef9 WatchSource:0}: Error finding container efa7155be81904f39efe7de1ec3e26cda983bd04d2f343a9549ca6431e82aef9: Status 404 returned error can't find the container with id efa7155be81904f39efe7de1ec3e26cda983bd04d2f343a9549ca6431e82aef9 Jul 27 16:01:31.294625 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:01:31.294587 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lv7ql" event={"ID":"4a1c9bc9-419e-4cdf-a105-0de7ae8815c3","Type":"ContainerStarted","Data":"efa7155be81904f39efe7de1ec3e26cda983bd04d2f343a9549ca6431e82aef9"} Jul 27 16:01:38.324647 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:01:38.324607 2561 generic.go:356] "Generic (PLEG): container finished" podID="4a1c9bc9-419e-4cdf-a105-0de7ae8815c3" containerID="01cb4930e681c047df9a4e1bafe6a2f8fa7496fa24ca8d33bb1b05bd5ff38976" exitCode=0 Jul 27 16:01:38.325150 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:01:38.324704 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lv7ql" event={"ID":"4a1c9bc9-419e-4cdf-a105-0de7ae8815c3","Type":"ContainerDied","Data":"01cb4930e681c047df9a4e1bafe6a2f8fa7496fa24ca8d33bb1b05bd5ff38976"} Jul 27 16:01:43.343947 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:01:43.343907 2561 generic.go:356] "Generic (PLEG): container finished" podID="4a1c9bc9-419e-4cdf-a105-0de7ae8815c3" containerID="b5275be874a77bccb915c384a75e58da9687a940d21736f3fee4ec2b964d87bc" exitCode=0 Jul 27 16:01:43.344326 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:01:43.343989 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lv7ql" event={"ID":"4a1c9bc9-419e-4cdf-a105-0de7ae8815c3","Type":"ContainerDied","Data":"b5275be874a77bccb915c384a75e58da9687a940d21736f3fee4ec2b964d87bc"} Jul 27 16:01:43.729405 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:01:43.729317 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:01:55.398443 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:01:55.398406 2561 generic.go:356] "Generic (PLEG): container finished" podID="4a1c9bc9-419e-4cdf-a105-0de7ae8815c3" containerID="b5a92fadc21ef1450de7c39ffc9ab790dffaa163fcbae9ac46dba0fce5682c3e" exitCode=0 Jul 27 16:01:55.398944 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:01:55.398492 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lv7ql" event={"ID":"4a1c9bc9-419e-4cdf-a105-0de7ae8815c3","Type":"ContainerDied","Data":"b5a92fadc21ef1450de7c39ffc9ab790dffaa163fcbae9ac46dba0fce5682c3e"} Jul 27 16:01:56.530272 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:01:56.530244 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lv7ql" Jul 27 16:01:56.579160 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:01:56.579125 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a1c9bc9-419e-4cdf-a105-0de7ae8815c3-bundle\") pod \"4a1c9bc9-419e-4cdf-a105-0de7ae8815c3\" (UID: \"4a1c9bc9-419e-4cdf-a105-0de7ae8815c3\") " Jul 27 16:01:56.579303 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:01:56.579170 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a1c9bc9-419e-4cdf-a105-0de7ae8815c3-util\") pod \"4a1c9bc9-419e-4cdf-a105-0de7ae8815c3\" (UID: \"4a1c9bc9-419e-4cdf-a105-0de7ae8815c3\") " Jul 27 16:01:56.579303 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:01:56.579202 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8c2m\" (UniqueName: \"kubernetes.io/projected/4a1c9bc9-419e-4cdf-a105-0de7ae8815c3-kube-api-access-b8c2m\") pod \"4a1c9bc9-419e-4cdf-a105-0de7ae8815c3\" (UID: \"4a1c9bc9-419e-4cdf-a105-0de7ae8815c3\") " Jul 27 16:01:56.579760 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:01:56.579731 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a1c9bc9-419e-4cdf-a105-0de7ae8815c3-bundle" (OuterVolumeSpecName: "bundle") pod "4a1c9bc9-419e-4cdf-a105-0de7ae8815c3" (UID: "4a1c9bc9-419e-4cdf-a105-0de7ae8815c3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 16:01:56.581519 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:01:56.581486 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a1c9bc9-419e-4cdf-a105-0de7ae8815c3-kube-api-access-b8c2m" (OuterVolumeSpecName: "kube-api-access-b8c2m") pod "4a1c9bc9-419e-4cdf-a105-0de7ae8815c3" (UID: "4a1c9bc9-419e-4cdf-a105-0de7ae8815c3"). InnerVolumeSpecName "kube-api-access-b8c2m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 16:01:56.583576 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:01:56.583554 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a1c9bc9-419e-4cdf-a105-0de7ae8815c3-util" (OuterVolumeSpecName: "util") pod "4a1c9bc9-419e-4cdf-a105-0de7ae8815c3" (UID: "4a1c9bc9-419e-4cdf-a105-0de7ae8815c3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 16:01:56.680225 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:01:56.680095 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a1c9bc9-419e-4cdf-a105-0de7ae8815c3-util\") on node \"ip-10-0-142-4.ec2.internal\" DevicePath \"\"" Jul 27 16:01:56.680225 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:01:56.680132 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8c2m\" (UniqueName: \"kubernetes.io/projected/4a1c9bc9-419e-4cdf-a105-0de7ae8815c3-kube-api-access-b8c2m\") on node \"ip-10-0-142-4.ec2.internal\" DevicePath \"\"" Jul 27 16:01:56.680225 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:01:56.680147 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a1c9bc9-419e-4cdf-a105-0de7ae8815c3-bundle\") on node \"ip-10-0-142-4.ec2.internal\" DevicePath \"\"" Jul 27 16:01:57.408994 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:01:57.408956 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lv7ql" event={"ID":"4a1c9bc9-419e-4cdf-a105-0de7ae8815c3","Type":"ContainerDied","Data":"efa7155be81904f39efe7de1ec3e26cda983bd04d2f343a9549ca6431e82aef9"} Jul 27 16:01:57.408994 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:01:57.408988 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lv7ql" Jul 27 16:01:57.409205 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:01:57.409010 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="efa7155be81904f39efe7de1ec3e26cda983bd04d2f343a9549ca6431e82aef9" Jul 27 16:02:01.420281 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:01.420238 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:02:02.255108 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:02.255065 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:02:04.989282 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:04.989247 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:02:07.637246 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:07.637201 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:02:09.522471 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:09.522439 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:02:09.630295 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:09.630249 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:02:09.874291 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:09.874257 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:02:09.947107 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:09.947068 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:02:11.918577 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:11.918538 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:02:12.191935 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:12.191853 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:02:19.120198 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:19.120163 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:02:21.201018 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:21.200977 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-z428l"] Jul 27 16:02:21.201401 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:21.201321 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a1c9bc9-419e-4cdf-a105-0de7ae8815c3" containerName="extract" Jul 27 16:02:21.201401 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:21.201335 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a1c9bc9-419e-4cdf-a105-0de7ae8815c3" containerName="extract" Jul 27 16:02:21.201401 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:21.201346 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a1c9bc9-419e-4cdf-a105-0de7ae8815c3" containerName="pull" Jul 27 16:02:21.201401 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:21.201351 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a1c9bc9-419e-4cdf-a105-0de7ae8815c3" containerName="pull" Jul 27 16:02:21.201401 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:21.201359 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a1c9bc9-419e-4cdf-a105-0de7ae8815c3" containerName="util" Jul 27 16:02:21.201401 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:21.201365 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a1c9bc9-419e-4cdf-a105-0de7ae8815c3" containerName="util" Jul 27 16:02:21.201587 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:21.201409 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a1c9bc9-419e-4cdf-a105-0de7ae8815c3" containerName="extract" Jul 27 16:02:21.204232 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:21.204216 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-z428l" Jul 27 16:02:21.206033 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:21.206013 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 27 16:02:21.206271 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:21.206257 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 27 16:02:21.206447 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:21.206434 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-tr56s\"" Jul 27 16:02:21.212030 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:21.212006 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-z428l"] Jul 27 16:02:21.284898 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:21.284853 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vn5g5\" (UniqueName: \"kubernetes.io/projected/d625949e-d0b7-4d3e-b09d-831a399e08ed-kube-api-access-vn5g5\") pod \"cert-manager-55b4d954d5-z428l\" (UID: \"d625949e-d0b7-4d3e-b09d-831a399e08ed\") " pod="cert-manager/cert-manager-55b4d954d5-z428l" Jul 27 16:02:21.285072 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:21.284937 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d625949e-d0b7-4d3e-b09d-831a399e08ed-bound-sa-token\") pod \"cert-manager-55b4d954d5-z428l\" (UID: \"d625949e-d0b7-4d3e-b09d-831a399e08ed\") " pod="cert-manager/cert-manager-55b4d954d5-z428l" Jul 27 16:02:21.386119 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:21.386087 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vn5g5\" (UniqueName: \"kubernetes.io/projected/d625949e-d0b7-4d3e-b09d-831a399e08ed-kube-api-access-vn5g5\") pod \"cert-manager-55b4d954d5-z428l\" (UID: \"d625949e-d0b7-4d3e-b09d-831a399e08ed\") " pod="cert-manager/cert-manager-55b4d954d5-z428l" Jul 27 16:02:21.386281 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:21.386134 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d625949e-d0b7-4d3e-b09d-831a399e08ed-bound-sa-token\") pod \"cert-manager-55b4d954d5-z428l\" (UID: \"d625949e-d0b7-4d3e-b09d-831a399e08ed\") " pod="cert-manager/cert-manager-55b4d954d5-z428l" Jul 27 16:02:21.393698 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:21.393664 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d625949e-d0b7-4d3e-b09d-831a399e08ed-bound-sa-token\") pod \"cert-manager-55b4d954d5-z428l\" (UID: \"d625949e-d0b7-4d3e-b09d-831a399e08ed\") " pod="cert-manager/cert-manager-55b4d954d5-z428l" Jul 27 16:02:21.393834 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:21.393744 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vn5g5\" (UniqueName: \"kubernetes.io/projected/d625949e-d0b7-4d3e-b09d-831a399e08ed-kube-api-access-vn5g5\") pod \"cert-manager-55b4d954d5-z428l\" (UID: \"d625949e-d0b7-4d3e-b09d-831a399e08ed\") " pod="cert-manager/cert-manager-55b4d954d5-z428l" Jul 27 16:02:21.513980 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:21.513897 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-z428l" Jul 27 16:02:21.647923 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:21.647890 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-z428l"] Jul 27 16:02:21.650859 ip-10-0-142-4 kubenswrapper[2561]: W0727 16:02:21.650825 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd625949e_d0b7_4d3e_b09d_831a399e08ed.slice/crio-3290f0734f4a074e8dccc0ca7422044ffb6f74aad7b070bea7aa4c8f718e0eb8 WatchSource:0}: Error finding container 3290f0734f4a074e8dccc0ca7422044ffb6f74aad7b070bea7aa4c8f718e0eb8: Status 404 returned error can't find the container with id 3290f0734f4a074e8dccc0ca7422044ffb6f74aad7b070bea7aa4c8f718e0eb8 Jul 27 16:02:22.505219 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:22.505182 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-z428l" event={"ID":"d625949e-d0b7-4d3e-b09d-831a399e08ed","Type":"ContainerStarted","Data":"3290f0734f4a074e8dccc0ca7422044ffb6f74aad7b070bea7aa4c8f718e0eb8"} Jul 27 16:02:24.514421 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:24.514335 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-z428l" event={"ID":"d625949e-d0b7-4d3e-b09d-831a399e08ed","Type":"ContainerStarted","Data":"ac2920c073e9d94fed55e8b9c3046936e481e3168502a8632e871fc80c9d048e"} Jul 27 16:02:24.529221 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:24.529165 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-z428l" podStartSLOduration=1.009606388 podStartE2EDuration="3.529147921s" totalImagesPullingTime="2.519541533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:02:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:02:24.528039604 +0000 UTC m=+515.321765882" watchObservedRunningTime="2026-07-27 16:02:24.529147921 +0000 UTC m=+515.322874199" Jul 27 16:02:27.685476 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:27.685442 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:02:27.786887 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:27.786848 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:02:30.621881 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:30.621844 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ejqd5r"] Jul 27 16:02:30.624117 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:30.624098 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ejqd5r" Jul 27 16:02:30.626378 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:30.626344 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 27 16:02:30.626518 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:30.626432 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 27 16:02:30.626518 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:30.626455 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-q7q78\"" Jul 27 16:02:30.634055 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:30.634026 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ejqd5r"] Jul 27 16:02:30.762473 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:30.762443 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/957cc531-f71b-4c39-9e3f-89175954d0af-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ejqd5r\" (UID: \"957cc531-f71b-4c39-9e3f-89175954d0af\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ejqd5r" Jul 27 16:02:30.762658 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:30.762481 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/957cc531-f71b-4c39-9e3f-89175954d0af-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ejqd5r\" (UID: \"957cc531-f71b-4c39-9e3f-89175954d0af\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ejqd5r" Jul 27 16:02:30.762658 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:30.762502 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsqkj\" (UniqueName: \"kubernetes.io/projected/957cc531-f71b-4c39-9e3f-89175954d0af-kube-api-access-bsqkj\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ejqd5r\" (UID: \"957cc531-f71b-4c39-9e3f-89175954d0af\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ejqd5r" Jul 27 16:02:30.863641 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:30.863607 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/957cc531-f71b-4c39-9e3f-89175954d0af-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ejqd5r\" (UID: \"957cc531-f71b-4c39-9e3f-89175954d0af\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ejqd5r" Jul 27 16:02:30.863641 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:30.863644 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/957cc531-f71b-4c39-9e3f-89175954d0af-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ejqd5r\" (UID: \"957cc531-f71b-4c39-9e3f-89175954d0af\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ejqd5r" Jul 27 16:02:30.863876 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:30.863668 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsqkj\" (UniqueName: \"kubernetes.io/projected/957cc531-f71b-4c39-9e3f-89175954d0af-kube-api-access-bsqkj\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ejqd5r\" (UID: \"957cc531-f71b-4c39-9e3f-89175954d0af\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ejqd5r" Jul 27 16:02:30.864093 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:30.864071 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/957cc531-f71b-4c39-9e3f-89175954d0af-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ejqd5r\" (UID: \"957cc531-f71b-4c39-9e3f-89175954d0af\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ejqd5r" Jul 27 16:02:30.864133 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:30.864082 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/957cc531-f71b-4c39-9e3f-89175954d0af-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ejqd5r\" (UID: \"957cc531-f71b-4c39-9e3f-89175954d0af\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ejqd5r" Jul 27 16:02:30.872529 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:30.872459 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsqkj\" (UniqueName: \"kubernetes.io/projected/957cc531-f71b-4c39-9e3f-89175954d0af-kube-api-access-bsqkj\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ejqd5r\" (UID: \"957cc531-f71b-4c39-9e3f-89175954d0af\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ejqd5r" Jul 27 16:02:30.934214 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:30.934171 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ejqd5r" Jul 27 16:02:31.062682 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:31.062653 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ejqd5r"] Jul 27 16:02:31.065308 ip-10-0-142-4 kubenswrapper[2561]: W0727 16:02:31.065278 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod957cc531_f71b_4c39_9e3f_89175954d0af.slice/crio-31decb18eec7aa6aa4e4437b3e8b5a8ea65cb83f6bb932d955a0c0372ef499f0 WatchSource:0}: Error finding container 31decb18eec7aa6aa4e4437b3e8b5a8ea65cb83f6bb932d955a0c0372ef499f0: Status 404 returned error can't find the container with id 31decb18eec7aa6aa4e4437b3e8b5a8ea65cb83f6bb932d955a0c0372ef499f0 Jul 27 16:02:31.540831 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:31.540730 2561 generic.go:356] "Generic (PLEG): container finished" podID="957cc531-f71b-4c39-9e3f-89175954d0af" containerID="564b944aa2a1fb83cb8b18dc6ae0143981c5e0839693ffc253c8ae6798b9580d" exitCode=0 Jul 27 16:02:31.540831 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:31.540774 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ejqd5r" event={"ID":"957cc531-f71b-4c39-9e3f-89175954d0af","Type":"ContainerDied","Data":"564b944aa2a1fb83cb8b18dc6ae0143981c5e0839693ffc253c8ae6798b9580d"} Jul 27 16:02:31.541026 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:31.540840 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ejqd5r" event={"ID":"957cc531-f71b-4c39-9e3f-89175954d0af","Type":"ContainerStarted","Data":"31decb18eec7aa6aa4e4437b3e8b5a8ea65cb83f6bb932d955a0c0372ef499f0"} Jul 27 16:02:32.638587 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:32.638551 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:02:32.708286 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:32.708243 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:02:34.555627 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:34.555595 2561 generic.go:356] "Generic (PLEG): container finished" podID="957cc531-f71b-4c39-9e3f-89175954d0af" containerID="1f57f98dd740727f69930e7741334b5b1f66714e87b5cdbc9c77810ee51119c5" exitCode=0 Jul 27 16:02:34.556073 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:34.555675 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ejqd5r" event={"ID":"957cc531-f71b-4c39-9e3f-89175954d0af","Type":"ContainerDied","Data":"1f57f98dd740727f69930e7741334b5b1f66714e87b5cdbc9c77810ee51119c5"} Jul 27 16:02:35.561622 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:35.561586 2561 generic.go:356] "Generic (PLEG): container finished" podID="957cc531-f71b-4c39-9e3f-89175954d0af" containerID="ecf8b10ba875fee9fecef6f1f75a72b98d8a8856a71b7ee5b746e972e18cf1d0" exitCode=0 Jul 27 16:02:35.562032 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:35.561636 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ejqd5r" event={"ID":"957cc531-f71b-4c39-9e3f-89175954d0af","Type":"ContainerDied","Data":"ecf8b10ba875fee9fecef6f1f75a72b98d8a8856a71b7ee5b746e972e18cf1d0"} Jul 27 16:02:36.689017 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:36.688985 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ejqd5r" Jul 27 16:02:36.711096 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:36.711059 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bsqkj\" (UniqueName: \"kubernetes.io/projected/957cc531-f71b-4c39-9e3f-89175954d0af-kube-api-access-bsqkj\") pod \"957cc531-f71b-4c39-9e3f-89175954d0af\" (UID: \"957cc531-f71b-4c39-9e3f-89175954d0af\") " Jul 27 16:02:36.711272 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:36.711122 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/957cc531-f71b-4c39-9e3f-89175954d0af-util\") pod \"957cc531-f71b-4c39-9e3f-89175954d0af\" (UID: \"957cc531-f71b-4c39-9e3f-89175954d0af\") " Jul 27 16:02:36.711272 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:36.711162 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/957cc531-f71b-4c39-9e3f-89175954d0af-bundle\") pod \"957cc531-f71b-4c39-9e3f-89175954d0af\" (UID: \"957cc531-f71b-4c39-9e3f-89175954d0af\") " Jul 27 16:02:36.711647 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:36.711624 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/957cc531-f71b-4c39-9e3f-89175954d0af-bundle" (OuterVolumeSpecName: "bundle") pod "957cc531-f71b-4c39-9e3f-89175954d0af" (UID: "957cc531-f71b-4c39-9e3f-89175954d0af"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 16:02:36.713305 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:36.713274 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/957cc531-f71b-4c39-9e3f-89175954d0af-kube-api-access-bsqkj" (OuterVolumeSpecName: "kube-api-access-bsqkj") pod "957cc531-f71b-4c39-9e3f-89175954d0af" (UID: "957cc531-f71b-4c39-9e3f-89175954d0af"). InnerVolumeSpecName "kube-api-access-bsqkj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 16:02:36.715877 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:36.715843 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/957cc531-f71b-4c39-9e3f-89175954d0af-util" (OuterVolumeSpecName: "util") pod "957cc531-f71b-4c39-9e3f-89175954d0af" (UID: "957cc531-f71b-4c39-9e3f-89175954d0af"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 16:02:36.812555 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:36.812522 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/957cc531-f71b-4c39-9e3f-89175954d0af-util\") on node \"ip-10-0-142-4.ec2.internal\" DevicePath \"\"" Jul 27 16:02:36.812555 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:36.812550 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/957cc531-f71b-4c39-9e3f-89175954d0af-bundle\") on node \"ip-10-0-142-4.ec2.internal\" DevicePath \"\"" Jul 27 16:02:36.812555 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:36.812562 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bsqkj\" (UniqueName: \"kubernetes.io/projected/957cc531-f71b-4c39-9e3f-89175954d0af-kube-api-access-bsqkj\") on node \"ip-10-0-142-4.ec2.internal\" DevicePath \"\"" Jul 27 16:02:37.572733 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:37.572693 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ejqd5r" event={"ID":"957cc531-f71b-4c39-9e3f-89175954d0af","Type":"ContainerDied","Data":"31decb18eec7aa6aa4e4437b3e8b5a8ea65cb83f6bb932d955a0c0372ef499f0"} Jul 27 16:02:37.572733 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:37.572734 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ejqd5r" Jul 27 16:02:37.572978 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:37.572756 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="31decb18eec7aa6aa4e4437b3e8b5a8ea65cb83f6bb932d955a0c0372ef499f0" Jul 27 16:02:41.085659 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:41.085616 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:02:41.183255 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:41.183208 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:02:47.238939 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:47.238885 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:02:48.118375 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:48.118332 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:02:48.325351 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:48.325311 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:02:49.540611 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:02:49.540568 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:03:32.155201 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:03:32.155163 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:03:50.823648 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:03:50.823588 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:03:50.971842 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:03:50.971787 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-rpngz"] Jul 27 16:03:50.972151 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:03:50.972135 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="957cc531-f71b-4c39-9e3f-89175954d0af" containerName="util" Jul 27 16:03:50.972230 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:03:50.972154 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="957cc531-f71b-4c39-9e3f-89175954d0af" containerName="util" Jul 27 16:03:50.972230 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:03:50.972181 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="957cc531-f71b-4c39-9e3f-89175954d0af" containerName="pull" Jul 27 16:03:50.972230 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:03:50.972189 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="957cc531-f71b-4c39-9e3f-89175954d0af" containerName="pull" Jul 27 16:03:50.972230 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:03:50.972207 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="957cc531-f71b-4c39-9e3f-89175954d0af" containerName="extract" Jul 27 16:03:50.972230 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:03:50.972216 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="957cc531-f71b-4c39-9e3f-89175954d0af" containerName="extract" Jul 27 16:03:50.972461 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:03:50.972293 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="957cc531-f71b-4c39-9e3f-89175954d0af" containerName="extract" Jul 27 16:03:50.975235 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:03:50.975215 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-rpngz" Jul 27 16:03:50.979437 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:03:50.979415 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"trainer-operator-system\"/\"trainer-operator-controller-manager-dockercfg-lzqx2\"" Jul 27 16:03:50.979565 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:03:50.979451 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"trainer-operator-system\"/\"openshift-service-ca.crt\"" Jul 27 16:03:50.979924 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:03:50.979909 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"trainer-operator-system\"/\"kube-root-ca.crt\"" Jul 27 16:03:50.980693 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:03:50.980672 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/7264bc03-3a2a-4c7f-92e9-29365a38ff72-manifests-work\") pod \"trainer-operator-controller-manager-56f5b7fd56-rpngz\" (UID: \"7264bc03-3a2a-4c7f-92e9-29365a38ff72\") " pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-rpngz" Jul 27 16:03:50.980776 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:03:50.980718 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7264bc03-3a2a-4c7f-92e9-29365a38ff72-tmp\") pod \"trainer-operator-controller-manager-56f5b7fd56-rpngz\" (UID: \"7264bc03-3a2a-4c7f-92e9-29365a38ff72\") " pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-rpngz" Jul 27 16:03:50.980776 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:03:50.980748 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m7pq\" (UniqueName: \"kubernetes.io/projected/7264bc03-3a2a-4c7f-92e9-29365a38ff72-kube-api-access-6m7pq\") pod \"trainer-operator-controller-manager-56f5b7fd56-rpngz\" (UID: \"7264bc03-3a2a-4c7f-92e9-29365a38ff72\") " pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-rpngz" Jul 27 16:03:50.988495 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:03:50.988470 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-rpngz"] Jul 27 16:03:51.081553 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:03:51.081462 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/7264bc03-3a2a-4c7f-92e9-29365a38ff72-manifests-work\") pod \"trainer-operator-controller-manager-56f5b7fd56-rpngz\" (UID: \"7264bc03-3a2a-4c7f-92e9-29365a38ff72\") " pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-rpngz" Jul 27 16:03:51.081553 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:03:51.081511 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7264bc03-3a2a-4c7f-92e9-29365a38ff72-tmp\") pod \"trainer-operator-controller-manager-56f5b7fd56-rpngz\" (UID: \"7264bc03-3a2a-4c7f-92e9-29365a38ff72\") " pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-rpngz" Jul 27 16:03:51.081553 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:03:51.081529 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m7pq\" (UniqueName: \"kubernetes.io/projected/7264bc03-3a2a-4c7f-92e9-29365a38ff72-kube-api-access-6m7pq\") pod \"trainer-operator-controller-manager-56f5b7fd56-rpngz\" (UID: \"7264bc03-3a2a-4c7f-92e9-29365a38ff72\") " pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-rpngz" Jul 27 16:03:51.081887 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:03:51.081871 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/7264bc03-3a2a-4c7f-92e9-29365a38ff72-manifests-work\") pod \"trainer-operator-controller-manager-56f5b7fd56-rpngz\" (UID: \"7264bc03-3a2a-4c7f-92e9-29365a38ff72\") " pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-rpngz" Jul 27 16:03:51.081948 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:03:51.081929 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7264bc03-3a2a-4c7f-92e9-29365a38ff72-tmp\") pod \"trainer-operator-controller-manager-56f5b7fd56-rpngz\" (UID: \"7264bc03-3a2a-4c7f-92e9-29365a38ff72\") " pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-rpngz" Jul 27 16:03:51.088664 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:03:51.088644 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m7pq\" (UniqueName: \"kubernetes.io/projected/7264bc03-3a2a-4c7f-92e9-29365a38ff72-kube-api-access-6m7pq\") pod \"trainer-operator-controller-manager-56f5b7fd56-rpngz\" (UID: \"7264bc03-3a2a-4c7f-92e9-29365a38ff72\") " pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-rpngz" Jul 27 16:03:51.285697 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:03:51.285657 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-rpngz" Jul 27 16:03:51.419229 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:03:51.419170 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-rpngz"] Jul 27 16:03:51.421939 ip-10-0-142-4 kubenswrapper[2561]: W0727 16:03:51.421907 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7264bc03_3a2a_4c7f_92e9_29365a38ff72.slice/crio-b41b18f6dd9bcb84300ca0ecd0c8c8147b3c4fe5a73bb425e3b2f8b4cbb55ba3 WatchSource:0}: Error finding container b41b18f6dd9bcb84300ca0ecd0c8c8147b3c4fe5a73bb425e3b2f8b4cbb55ba3: Status 404 returned error can't find the container with id b41b18f6dd9bcb84300ca0ecd0c8c8147b3c4fe5a73bb425e3b2f8b4cbb55ba3 Jul 27 16:03:51.860306 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:03:51.860267 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-rpngz" event={"ID":"7264bc03-3a2a-4c7f-92e9-29365a38ff72","Type":"ContainerStarted","Data":"b41b18f6dd9bcb84300ca0ecd0c8c8147b3c4fe5a73bb425e3b2f8b4cbb55ba3"} Jul 27 16:03:52.478011 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:03:52.477969 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:03:55.879026 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:03:55.878993 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-rpngz" event={"ID":"7264bc03-3a2a-4c7f-92e9-29365a38ff72","Type":"ContainerStarted","Data":"b3ddfcfa9b3c75df6f6eeac6fcac13f29d5041aa3f0209da1b5819a83d6dc66c"} Jul 27 16:03:55.879436 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:03:55.879067 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-rpngz" Jul 27 16:03:55.896927 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:03:55.896872 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-rpngz" podStartSLOduration=1.5949221040000001 podStartE2EDuration="5.896848692s" totalImagesPullingTime="4.301926588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:03:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:03:55.896577636 +0000 UTC m=+606.690303916" watchObservedRunningTime="2026-07-27 16:03:55.896848692 +0000 UTC m=+606.690574987" Jul 27 16:04:02.025121 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:04:02.025080 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:04:03.794600 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:04:03.794552 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:04:03.850189 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:04:03.850156 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:04:06.492820 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:04:06.492764 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:04:06.588588 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:04:06.588551 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:04:06.708318 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:04:06.708281 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:04:06.886184 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:04:06.886152 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-rpngz" Jul 27 16:04:07.218381 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:04:07.218287 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:04:07.276116 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:04:07.276086 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:04:10.548464 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:04:10.548433 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:04:10.610523 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:04:10.610492 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:04:17.754905 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:04:17.754793 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:04:17.855062 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:04:17.855033 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:04:17.955945 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:04:17.955896 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:04:41.732427 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:04:41.732387 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:04:43.620316 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:04:43.620271 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:04:44.162350 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:04:44.162313 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:04:44.173594 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:04:44.173560 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-w29z2"] Jul 27 16:04:44.176747 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:04:44.176722 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-w29z2" Jul 27 16:04:44.178691 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:04:44.178669 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 27 16:04:44.178810 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:04:44.178697 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Jul 27 16:04:44.178870 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:04:44.178851 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Jul 27 16:04:44.179322 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:04:44.179304 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-qzbws\"" Jul 27 16:04:44.179373 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:04:44.179306 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 27 16:04:44.191929 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:04:44.191904 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-w29z2"] Jul 27 16:04:44.288236 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:04:44.288204 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e156e517-836a-43bd-b728-cfc48d5a73be-cert\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-w29z2\" (UID: \"e156e517-836a-43bd-b728-cfc48d5a73be\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-w29z2" Jul 27 16:04:44.288443 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:04:44.288278 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfljl\" (UniqueName: \"kubernetes.io/projected/e156e517-836a-43bd-b728-cfc48d5a73be-kube-api-access-pfljl\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-w29z2\" (UID: \"e156e517-836a-43bd-b728-cfc48d5a73be\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-w29z2" Jul 27 16:04:44.288443 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:04:44.288349 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/e156e517-836a-43bd-b728-cfc48d5a73be-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-w29z2\" (UID: \"e156e517-836a-43bd-b728-cfc48d5a73be\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-w29z2" Jul 27 16:04:44.389206 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:04:44.389166 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfljl\" (UniqueName: \"kubernetes.io/projected/e156e517-836a-43bd-b728-cfc48d5a73be-kube-api-access-pfljl\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-w29z2\" (UID: \"e156e517-836a-43bd-b728-cfc48d5a73be\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-w29z2" Jul 27 16:04:44.389206 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:04:44.389206 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/e156e517-836a-43bd-b728-cfc48d5a73be-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-w29z2\" (UID: \"e156e517-836a-43bd-b728-cfc48d5a73be\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-w29z2" Jul 27 16:04:44.389456 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:04:44.389231 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e156e517-836a-43bd-b728-cfc48d5a73be-cert\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-w29z2\" (UID: \"e156e517-836a-43bd-b728-cfc48d5a73be\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-w29z2" Jul 27 16:04:44.389934 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:04:44.389908 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/e156e517-836a-43bd-b728-cfc48d5a73be-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-w29z2\" (UID: \"e156e517-836a-43bd-b728-cfc48d5a73be\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-w29z2" Jul 27 16:04:44.391539 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:04:44.391517 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e156e517-836a-43bd-b728-cfc48d5a73be-cert\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-w29z2\" (UID: \"e156e517-836a-43bd-b728-cfc48d5a73be\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-w29z2" Jul 27 16:04:44.402537 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:04:44.402504 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfljl\" (UniqueName: \"kubernetes.io/projected/e156e517-836a-43bd-b728-cfc48d5a73be-kube-api-access-pfljl\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-w29z2\" (UID: \"e156e517-836a-43bd-b728-cfc48d5a73be\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-w29z2" Jul 27 16:04:44.486088 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:04:44.485999 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-w29z2" Jul 27 16:04:44.626891 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:04:44.626851 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-w29z2"] Jul 27 16:04:44.630111 ip-10-0-142-4 kubenswrapper[2561]: W0727 16:04:44.630083 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode156e517_836a_43bd_b728_cfc48d5a73be.slice/crio-68a8e7f7874eb8ac84528cbae2d7bc0504802cbefa5eb001b9cc9a9e27ecde83 WatchSource:0}: Error finding container 68a8e7f7874eb8ac84528cbae2d7bc0504802cbefa5eb001b9cc9a9e27ecde83: Status 404 returned error can't find the container with id 68a8e7f7874eb8ac84528cbae2d7bc0504802cbefa5eb001b9cc9a9e27ecde83 Jul 27 16:04:44.631885 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:04:44.631866 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 27 16:04:44.846685 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:04:44.846650 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:04:45.072548 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:04:45.072513 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-w29z2" event={"ID":"e156e517-836a-43bd-b728-cfc48d5a73be","Type":"ContainerStarted","Data":"68a8e7f7874eb8ac84528cbae2d7bc0504802cbefa5eb001b9cc9a9e27ecde83"} Jul 27 16:04:48.088199 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:04:48.088157 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-w29z2" event={"ID":"e156e517-836a-43bd-b728-cfc48d5a73be","Type":"ContainerStarted","Data":"8a295187fd9a02f06a463df3cfc7c3a7afa690ea002036a9e392ddfb1498ff3b"} Jul 27 16:04:48.088708 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:04:48.088238 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-w29z2" Jul 27 16:04:48.509313 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:04:48.509218 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:05:04.097835 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:05:04.097787 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-w29z2" Jul 27 16:05:04.114563 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:05:04.114505 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-w29z2" podStartSLOduration=17.550462714 podStartE2EDuration="20.114488745s" totalImagesPullingTime="2.564026031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:04:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:04:48.114021517 +0000 UTC m=+658.907747798" watchObservedRunningTime="2026-07-27 16:05:04.114488745 +0000 UTC m=+674.908215024" Jul 27 16:05:07.755722 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:05:07.755684 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-vknbt"] Jul 27 16:05:07.760173 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:05:07.760153 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-vknbt" Jul 27 16:05:07.763280 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:05:07.763256 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-ql7wz\"" Jul 27 16:05:07.773330 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:05:07.773298 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-vknbt"] Jul 27 16:05:07.878210 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:05:07.878168 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:05:07.890297 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:05:07.890268 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4bpn\" (UniqueName: \"kubernetes.io/projected/90bf27c8-c6d0-4d5e-9987-4b111e8f02cf-kube-api-access-b4bpn\") pod \"test-trainjob-workflow-node-0-0-vknbt\" (UID: \"90bf27c8-c6d0-4d5e-9987-4b111e8f02cf\") " pod="opendatahub/test-trainjob-workflow-node-0-0-vknbt" Jul 27 16:05:07.991038 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:05:07.990997 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4bpn\" (UniqueName: \"kubernetes.io/projected/90bf27c8-c6d0-4d5e-9987-4b111e8f02cf-kube-api-access-b4bpn\") pod \"test-trainjob-workflow-node-0-0-vknbt\" (UID: \"90bf27c8-c6d0-4d5e-9987-4b111e8f02cf\") " pod="opendatahub/test-trainjob-workflow-node-0-0-vknbt" Jul 27 16:05:08.000784 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:05:08.000755 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4bpn\" (UniqueName: \"kubernetes.io/projected/90bf27c8-c6d0-4d5e-9987-4b111e8f02cf-kube-api-access-b4bpn\") pod \"test-trainjob-workflow-node-0-0-vknbt\" (UID: \"90bf27c8-c6d0-4d5e-9987-4b111e8f02cf\") " pod="opendatahub/test-trainjob-workflow-node-0-0-vknbt" Jul 27 16:05:08.068749 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:05:08.068715 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-vknbt" Jul 27 16:05:08.206631 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:05:08.206598 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-vknbt"] Jul 27 16:05:08.209351 ip-10-0-142-4 kubenswrapper[2561]: W0727 16:05:08.209319 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod90bf27c8_c6d0_4d5e_9987_4b111e8f02cf.slice/crio-14f0404779bff530ba937b7ec41dbb59b3e818e08159a3e709d8db54e76f2847 WatchSource:0}: Error finding container 14f0404779bff530ba937b7ec41dbb59b3e818e08159a3e709d8db54e76f2847: Status 404 returned error can't find the container with id 14f0404779bff530ba937b7ec41dbb59b3e818e08159a3e709d8db54e76f2847 Jul 27 16:05:09.177949 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:05:09.177911 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-vknbt" event={"ID":"90bf27c8-c6d0-4d5e-9987-4b111e8f02cf","Type":"ContainerStarted","Data":"14f0404779bff530ba937b7ec41dbb59b3e818e08159a3e709d8db54e76f2847"} Jul 27 16:06:19.532373 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:19.532339 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-vknbt" event={"ID":"90bf27c8-c6d0-4d5e-9987-4b111e8f02cf","Type":"ContainerStarted","Data":"4b63030155ca3d83ff993a5e99804bc4d805d6f5002bdba3f94ece5cdabcda69"} Jul 27 16:06:19.549890 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:19.549834 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-trainjob-workflow-node-0-0-vknbt" podStartSLOduration=1.35590962 podStartE2EDuration="1m12.549792726s" totalImagesPullingTime="1m11.193883106s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:05:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:06:19.54911151 +0000 UTC m=+750.342837789" watchObservedRunningTime="2026-07-27 16:06:19.549792726 +0000 UTC m=+750.343519015" Jul 27 16:06:22.552136 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:22.552098 2561 generic.go:356] "Generic (PLEG): container finished" podID="90bf27c8-c6d0-4d5e-9987-4b111e8f02cf" containerID="4b63030155ca3d83ff993a5e99804bc4d805d6f5002bdba3f94ece5cdabcda69" exitCode=0 Jul 27 16:06:22.552667 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:22.552142 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-vknbt" event={"ID":"90bf27c8-c6d0-4d5e-9987-4b111e8f02cf","Type":"ContainerDied","Data":"4b63030155ca3d83ff993a5e99804bc4d805d6f5002bdba3f94ece5cdabcda69"} Jul 27 16:06:23.729729 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:23.729686 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-vknbt" Jul 27 16:06:23.850634 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:23.850541 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b4bpn\" (UniqueName: \"kubernetes.io/projected/90bf27c8-c6d0-4d5e-9987-4b111e8f02cf-kube-api-access-b4bpn\") pod \"90bf27c8-c6d0-4d5e-9987-4b111e8f02cf\" (UID: \"90bf27c8-c6d0-4d5e-9987-4b111e8f02cf\") " Jul 27 16:06:23.852775 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:23.852741 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90bf27c8-c6d0-4d5e-9987-4b111e8f02cf-kube-api-access-b4bpn" (OuterVolumeSpecName: "kube-api-access-b4bpn") pod "90bf27c8-c6d0-4d5e-9987-4b111e8f02cf" (UID: "90bf27c8-c6d0-4d5e-9987-4b111e8f02cf"). InnerVolumeSpecName "kube-api-access-b4bpn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 16:06:23.951237 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:23.951197 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b4bpn\" (UniqueName: \"kubernetes.io/projected/90bf27c8-c6d0-4d5e-9987-4b111e8f02cf-kube-api-access-b4bpn\") on node \"ip-10-0-142-4.ec2.internal\" DevicePath \"\"" Jul 27 16:06:24.561990 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:24.561961 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-vknbt" Jul 27 16:06:24.561990 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:24.561980 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-vknbt" event={"ID":"90bf27c8-c6d0-4d5e-9987-4b111e8f02cf","Type":"ContainerDied","Data":"14f0404779bff530ba937b7ec41dbb59b3e818e08159a3e709d8db54e76f2847"} Jul 27 16:06:24.562197 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:24.562017 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="14f0404779bff530ba937b7ec41dbb59b3e818e08159a3e709d8db54e76f2847" Jul 27 16:06:25.080790 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:25.080750 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-vknbt"] Jul 27 16:06:25.086468 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:25.086438 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-vknbt"] Jul 27 16:06:25.122184 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:25.122151 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:06:25.280865 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:25.280825 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:06:25.291215 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:25.291183 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-w29z2"] Jul 27 16:06:25.291428 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:25.291406 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-w29z2" podUID="e156e517-836a-43bd-b728-cfc48d5a73be" containerName="manager" containerID="cri-o://8a295187fd9a02f06a463df3cfc7c3a7afa690ea002036a9e392ddfb1498ff3b" gracePeriod=30 Jul 27 16:06:25.382838 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:25.382745 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:06:25.567211 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:25.567182 2561 generic.go:356] "Generic (PLEG): container finished" podID="e156e517-836a-43bd-b728-cfc48d5a73be" containerID="8a295187fd9a02f06a463df3cfc7c3a7afa690ea002036a9e392ddfb1498ff3b" exitCode=0 Jul 27 16:06:25.567348 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:25.567253 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-w29z2" event={"ID":"e156e517-836a-43bd-b728-cfc48d5a73be","Type":"ContainerDied","Data":"8a295187fd9a02f06a463df3cfc7c3a7afa690ea002036a9e392ddfb1498ff3b"} Jul 27 16:06:25.567348 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:25.567291 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-w29z2" event={"ID":"e156e517-836a-43bd-b728-cfc48d5a73be","Type":"ContainerDied","Data":"68a8e7f7874eb8ac84528cbae2d7bc0504802cbefa5eb001b9cc9a9e27ecde83"} Jul 27 16:06:25.567348 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:25.567304 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="68a8e7f7874eb8ac84528cbae2d7bc0504802cbefa5eb001b9cc9a9e27ecde83" Jul 27 16:06:25.604744 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:25.604714 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-w29z2" Jul 27 16:06:25.635595 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:25.635527 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90bf27c8-c6d0-4d5e-9987-4b111e8f02cf" path="/var/lib/kubelet/pods/90bf27c8-c6d0-4d5e-9987-4b111e8f02cf/volumes" Jul 27 16:06:25.666391 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:25.666361 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pfljl\" (UniqueName: \"kubernetes.io/projected/e156e517-836a-43bd-b728-cfc48d5a73be-kube-api-access-pfljl\") pod \"e156e517-836a-43bd-b728-cfc48d5a73be\" (UID: \"e156e517-836a-43bd-b728-cfc48d5a73be\") " Jul 27 16:06:25.666563 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:25.666443 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e156e517-836a-43bd-b728-cfc48d5a73be-cert\") pod \"e156e517-836a-43bd-b728-cfc48d5a73be\" (UID: \"e156e517-836a-43bd-b728-cfc48d5a73be\") " Jul 27 16:06:25.666563 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:25.666473 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/e156e517-836a-43bd-b728-cfc48d5a73be-kubeflow-trainer-config\") pod \"e156e517-836a-43bd-b728-cfc48d5a73be\" (UID: \"e156e517-836a-43bd-b728-cfc48d5a73be\") " Jul 27 16:06:25.669048 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:25.669005 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e156e517-836a-43bd-b728-cfc48d5a73be-cert" (OuterVolumeSpecName: "cert") pod "e156e517-836a-43bd-b728-cfc48d5a73be" (UID: "e156e517-836a-43bd-b728-cfc48d5a73be"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 16:06:25.669305 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:25.669279 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e156e517-836a-43bd-b728-cfc48d5a73be-kube-api-access-pfljl" (OuterVolumeSpecName: "kube-api-access-pfljl") pod "e156e517-836a-43bd-b728-cfc48d5a73be" (UID: "e156e517-836a-43bd-b728-cfc48d5a73be"). InnerVolumeSpecName "kube-api-access-pfljl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 16:06:25.671380 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:25.671350 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e156e517-836a-43bd-b728-cfc48d5a73be-kubeflow-trainer-config" (OuterVolumeSpecName: "kubeflow-trainer-config") pod "e156e517-836a-43bd-b728-cfc48d5a73be" (UID: "e156e517-836a-43bd-b728-cfc48d5a73be"). InnerVolumeSpecName "kubeflow-trainer-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 16:06:25.712698 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:25.712658 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:06:25.767858 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:25.767828 2561 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e156e517-836a-43bd-b728-cfc48d5a73be-cert\") on node \"ip-10-0-142-4.ec2.internal\" DevicePath \"\"" Jul 27 16:06:25.767858 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:25.767855 2561 reconciler_common.go:299] "Volume detached for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/e156e517-836a-43bd-b728-cfc48d5a73be-kubeflow-trainer-config\") on node \"ip-10-0-142-4.ec2.internal\" DevicePath \"\"" Jul 27 16:06:25.768047 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:25.767866 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pfljl\" (UniqueName: \"kubernetes.io/projected/e156e517-836a-43bd-b728-cfc48d5a73be-kube-api-access-pfljl\") on node \"ip-10-0-142-4.ec2.internal\" DevicePath \"\"" Jul 27 16:06:25.818901 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:25.818864 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:06:26.571846 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:26.571814 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-w29z2" Jul 27 16:06:26.612248 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:26.612214 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-w29z2"] Jul 27 16:06:26.615225 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:26.615201 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-w29z2"] Jul 27 16:06:27.635905 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:27.635866 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e156e517-836a-43bd-b728-cfc48d5a73be" path="/var/lib/kubelet/pods/e156e517-836a-43bd-b728-cfc48d5a73be/volumes" Jul 27 16:06:28.407935 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:28.407892 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-6544bfd68-r6nds"] Jul 27 16:06:28.408303 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:28.408285 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e156e517-836a-43bd-b728-cfc48d5a73be" containerName="manager" Jul 27 16:06:28.408386 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:28.408307 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e156e517-836a-43bd-b728-cfc48d5a73be" containerName="manager" Jul 27 16:06:28.408386 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:28.408345 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90bf27c8-c6d0-4d5e-9987-4b111e8f02cf" containerName="node" Jul 27 16:06:28.408386 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:28.408354 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="90bf27c8-c6d0-4d5e-9987-4b111e8f02cf" containerName="node" Jul 27 16:06:28.408526 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:28.408430 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e156e517-836a-43bd-b728-cfc48d5a73be" containerName="manager" Jul 27 16:06:28.408526 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:28.408446 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="90bf27c8-c6d0-4d5e-9987-4b111e8f02cf" containerName="node" Jul 27 16:06:28.428295 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:28.428265 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-6544bfd68-r6nds"] Jul 27 16:06:28.428451 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:28.428386 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="trainer-operator-system/trainer-operator-controller-manager-6544bfd68-r6nds" Jul 27 16:06:28.492545 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:28.492501 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/baacac58-6ad2-4e96-b9b5-82d77431e9bd-manifests-work\") pod \"trainer-operator-controller-manager-6544bfd68-r6nds\" (UID: \"baacac58-6ad2-4e96-b9b5-82d77431e9bd\") " pod="trainer-operator-system/trainer-operator-controller-manager-6544bfd68-r6nds" Jul 27 16:06:28.492545 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:28.492552 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/baacac58-6ad2-4e96-b9b5-82d77431e9bd-tmp\") pod \"trainer-operator-controller-manager-6544bfd68-r6nds\" (UID: \"baacac58-6ad2-4e96-b9b5-82d77431e9bd\") " pod="trainer-operator-system/trainer-operator-controller-manager-6544bfd68-r6nds" Jul 27 16:06:28.492753 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:28.492645 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cwhz\" (UniqueName: \"kubernetes.io/projected/baacac58-6ad2-4e96-b9b5-82d77431e9bd-kube-api-access-4cwhz\") pod \"trainer-operator-controller-manager-6544bfd68-r6nds\" (UID: \"baacac58-6ad2-4e96-b9b5-82d77431e9bd\") " pod="trainer-operator-system/trainer-operator-controller-manager-6544bfd68-r6nds" Jul 27 16:06:28.593843 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:28.593786 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/baacac58-6ad2-4e96-b9b5-82d77431e9bd-manifests-work\") pod \"trainer-operator-controller-manager-6544bfd68-r6nds\" (UID: \"baacac58-6ad2-4e96-b9b5-82d77431e9bd\") " pod="trainer-operator-system/trainer-operator-controller-manager-6544bfd68-r6nds" Jul 27 16:06:28.594019 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:28.593857 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/baacac58-6ad2-4e96-b9b5-82d77431e9bd-tmp\") pod \"trainer-operator-controller-manager-6544bfd68-r6nds\" (UID: \"baacac58-6ad2-4e96-b9b5-82d77431e9bd\") " pod="trainer-operator-system/trainer-operator-controller-manager-6544bfd68-r6nds" Jul 27 16:06:28.594019 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:28.593894 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cwhz\" (UniqueName: \"kubernetes.io/projected/baacac58-6ad2-4e96-b9b5-82d77431e9bd-kube-api-access-4cwhz\") pod \"trainer-operator-controller-manager-6544bfd68-r6nds\" (UID: \"baacac58-6ad2-4e96-b9b5-82d77431e9bd\") " pod="trainer-operator-system/trainer-operator-controller-manager-6544bfd68-r6nds" Jul 27 16:06:28.594152 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:28.594131 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/baacac58-6ad2-4e96-b9b5-82d77431e9bd-manifests-work\") pod \"trainer-operator-controller-manager-6544bfd68-r6nds\" (UID: \"baacac58-6ad2-4e96-b9b5-82d77431e9bd\") " pod="trainer-operator-system/trainer-operator-controller-manager-6544bfd68-r6nds" Jul 27 16:06:28.594222 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:28.594202 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/baacac58-6ad2-4e96-b9b5-82d77431e9bd-tmp\") pod \"trainer-operator-controller-manager-6544bfd68-r6nds\" (UID: \"baacac58-6ad2-4e96-b9b5-82d77431e9bd\") " pod="trainer-operator-system/trainer-operator-controller-manager-6544bfd68-r6nds" Jul 27 16:06:28.607135 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:28.607104 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cwhz\" (UniqueName: \"kubernetes.io/projected/baacac58-6ad2-4e96-b9b5-82d77431e9bd-kube-api-access-4cwhz\") pod \"trainer-operator-controller-manager-6544bfd68-r6nds\" (UID: \"baacac58-6ad2-4e96-b9b5-82d77431e9bd\") " pod="trainer-operator-system/trainer-operator-controller-manager-6544bfd68-r6nds" Jul 27 16:06:28.738538 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:28.738422 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="trainer-operator-system/trainer-operator-controller-manager-6544bfd68-r6nds" Jul 27 16:06:28.880547 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:28.880516 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-6544bfd68-r6nds"] Jul 27 16:06:28.883877 ip-10-0-142-4 kubenswrapper[2561]: W0727 16:06:28.883845 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaacac58_6ad2_4e96_b9b5_82d77431e9bd.slice/crio-195288fd53297853c2962753a66b046c12158900c35cdd3b1a5546b284b91248 WatchSource:0}: Error finding container 195288fd53297853c2962753a66b046c12158900c35cdd3b1a5546b284b91248: Status 404 returned error can't find the container with id 195288fd53297853c2962753a66b046c12158900c35cdd3b1a5546b284b91248 Jul 27 16:06:29.587102 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:29.587012 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="trainer-operator-system/trainer-operator-controller-manager-6544bfd68-r6nds" event={"ID":"baacac58-6ad2-4e96-b9b5-82d77431e9bd","Type":"ContainerStarted","Data":"195288fd53297853c2962753a66b046c12158900c35cdd3b1a5546b284b91248"} Jul 27 16:06:29.937332 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:29.937242 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-cwcbw/must-gather-lqcfl"] Jul 27 16:06:29.940912 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:29.940887 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cwcbw/must-gather-lqcfl" Jul 27 16:06:29.942857 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:29.942828 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cwcbw\"/\"openshift-service-ca.crt\"" Jul 27 16:06:29.942997 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:29.942963 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cwcbw\"/\"kube-root-ca.crt\"" Jul 27 16:06:29.943880 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:29.943789 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-cwcbw\"/\"default-dockercfg-vb6xf\"" Jul 27 16:06:29.943998 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:29.943959 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:06:29.954682 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:29.954655 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cwcbw/must-gather-lqcfl"] Jul 27 16:06:30.006518 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:30.006484 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk66g\" (UniqueName: \"kubernetes.io/projected/d8d441b3-c732-4edc-bc12-6a261fd93d27-kube-api-access-rk66g\") pod \"must-gather-lqcfl\" (UID: \"d8d441b3-c732-4edc-bc12-6a261fd93d27\") " pod="openshift-must-gather-cwcbw/must-gather-lqcfl" Jul 27 16:06:30.006518 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:30.006520 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d8d441b3-c732-4edc-bc12-6a261fd93d27-must-gather-output\") pod \"must-gather-lqcfl\" (UID: \"d8d441b3-c732-4edc-bc12-6a261fd93d27\") " pod="openshift-must-gather-cwcbw/must-gather-lqcfl" Jul 27 16:06:30.029512 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:30.029480 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:06:30.107187 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:30.107145 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rk66g\" (UniqueName: \"kubernetes.io/projected/d8d441b3-c732-4edc-bc12-6a261fd93d27-kube-api-access-rk66g\") pod \"must-gather-lqcfl\" (UID: \"d8d441b3-c732-4edc-bc12-6a261fd93d27\") " pod="openshift-must-gather-cwcbw/must-gather-lqcfl" Jul 27 16:06:30.107187 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:30.107190 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d8d441b3-c732-4edc-bc12-6a261fd93d27-must-gather-output\") pod \"must-gather-lqcfl\" (UID: \"d8d441b3-c732-4edc-bc12-6a261fd93d27\") " pod="openshift-must-gather-cwcbw/must-gather-lqcfl" Jul 27 16:06:30.107616 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:30.107594 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d8d441b3-c732-4edc-bc12-6a261fd93d27-must-gather-output\") pod \"must-gather-lqcfl\" (UID: \"d8d441b3-c732-4edc-bc12-6a261fd93d27\") " pod="openshift-must-gather-cwcbw/must-gather-lqcfl" Jul 27 16:06:30.117034 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:30.117002 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk66g\" (UniqueName: \"kubernetes.io/projected/d8d441b3-c732-4edc-bc12-6a261fd93d27-kube-api-access-rk66g\") pod \"must-gather-lqcfl\" (UID: \"d8d441b3-c732-4edc-bc12-6a261fd93d27\") " pod="openshift-must-gather-cwcbw/must-gather-lqcfl" Jul 27 16:06:30.252959 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:30.252863 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cwcbw/must-gather-lqcfl" Jul 27 16:06:30.395631 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:30.395603 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cwcbw/must-gather-lqcfl"] Jul 27 16:06:30.397766 ip-10-0-142-4 kubenswrapper[2561]: W0727 16:06:30.397723 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd8d441b3_c732_4edc_bc12_6a261fd93d27.slice/crio-8abc1d75bebb2643d004f02b8d8f8f66cd9bd5de82fcffc1d41aa041ca5cfb29 WatchSource:0}: Error finding container 8abc1d75bebb2643d004f02b8d8f8f66cd9bd5de82fcffc1d41aa041ca5cfb29: Status 404 returned error can't find the container with id 8abc1d75bebb2643d004f02b8d8f8f66cd9bd5de82fcffc1d41aa041ca5cfb29 Jul 27 16:06:30.592951 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:30.592907 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cwcbw/must-gather-lqcfl" event={"ID":"d8d441b3-c732-4edc-bc12-6a261fd93d27","Type":"ContainerStarted","Data":"8abc1d75bebb2643d004f02b8d8f8f66cd9bd5de82fcffc1d41aa041ca5cfb29"} Jul 27 16:06:31.599095 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:31.599059 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="trainer-operator-system/trainer-operator-controller-manager-6544bfd68-r6nds" event={"ID":"baacac58-6ad2-4e96-b9b5-82d77431e9bd","Type":"ContainerStarted","Data":"00847922391e51d78530eec7238b7e7891153c46cdb41f8c653b39157089863a"} Jul 27 16:06:31.599577 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:31.599164 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="trainer-operator-system/trainer-operator-controller-manager-6544bfd68-r6nds" Jul 27 16:06:31.620414 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:31.620352 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="trainer-operator-system/trainer-operator-controller-manager-6544bfd68-r6nds" podStartSLOduration=1.241351245 podStartE2EDuration="3.620336299s" totalImagesPullingTime="2.378985054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:06:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:06:31.61913951 +0000 UTC m=+762.412865790" watchObservedRunningTime="2026-07-27 16:06:31.620336299 +0000 UTC m=+762.414062579" Jul 27 16:06:42.605962 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:42.605929 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="trainer-operator-system/trainer-operator-controller-manager-6544bfd68-r6nds" Jul 27 16:06:42.654123 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:42.654085 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-rpngz"] Jul 27 16:06:42.654322 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:42.654281 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-rpngz" podUID="7264bc03-3a2a-4c7f-92e9-29365a38ff72" containerName="manager" containerID="cri-o://b3ddfcfa9b3c75df6f6eeac6fcac13f29d5041aa3f0209da1b5819a83d6dc66c" gracePeriod=10 Jul 27 16:06:42.992446 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:42.992410 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-rpngz" Jul 27 16:06:43.124402 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:43.124359 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6m7pq\" (UniqueName: \"kubernetes.io/projected/7264bc03-3a2a-4c7f-92e9-29365a38ff72-kube-api-access-6m7pq\") pod \"7264bc03-3a2a-4c7f-92e9-29365a38ff72\" (UID: \"7264bc03-3a2a-4c7f-92e9-29365a38ff72\") " Jul 27 16:06:43.124597 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:43.124422 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7264bc03-3a2a-4c7f-92e9-29365a38ff72-tmp\") pod \"7264bc03-3a2a-4c7f-92e9-29365a38ff72\" (UID: \"7264bc03-3a2a-4c7f-92e9-29365a38ff72\") " Jul 27 16:06:43.124597 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:43.124448 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/7264bc03-3a2a-4c7f-92e9-29365a38ff72-manifests-work\") pod \"7264bc03-3a2a-4c7f-92e9-29365a38ff72\" (UID: \"7264bc03-3a2a-4c7f-92e9-29365a38ff72\") " Jul 27 16:06:43.124760 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:43.124726 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7264bc03-3a2a-4c7f-92e9-29365a38ff72-tmp" (OuterVolumeSpecName: "tmp") pod "7264bc03-3a2a-4c7f-92e9-29365a38ff72" (UID: "7264bc03-3a2a-4c7f-92e9-29365a38ff72"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 16:06:43.126668 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:43.126637 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7264bc03-3a2a-4c7f-92e9-29365a38ff72-kube-api-access-6m7pq" (OuterVolumeSpecName: "kube-api-access-6m7pq") pod "7264bc03-3a2a-4c7f-92e9-29365a38ff72" (UID: "7264bc03-3a2a-4c7f-92e9-29365a38ff72"). InnerVolumeSpecName "kube-api-access-6m7pq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 16:06:43.127741 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:43.127716 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7264bc03-3a2a-4c7f-92e9-29365a38ff72-manifests-work" (OuterVolumeSpecName: "manifests-work") pod "7264bc03-3a2a-4c7f-92e9-29365a38ff72" (UID: "7264bc03-3a2a-4c7f-92e9-29365a38ff72"). InnerVolumeSpecName "manifests-work". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 16:06:43.225634 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:43.225547 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6m7pq\" (UniqueName: \"kubernetes.io/projected/7264bc03-3a2a-4c7f-92e9-29365a38ff72-kube-api-access-6m7pq\") on node \"ip-10-0-142-4.ec2.internal\" DevicePath \"\"" Jul 27 16:06:43.225634 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:43.225578 2561 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7264bc03-3a2a-4c7f-92e9-29365a38ff72-tmp\") on node \"ip-10-0-142-4.ec2.internal\" DevicePath \"\"" Jul 27 16:06:43.225634 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:43.225589 2561 reconciler_common.go:299] "Volume detached for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/7264bc03-3a2a-4c7f-92e9-29365a38ff72-manifests-work\") on node \"ip-10-0-142-4.ec2.internal\" DevicePath \"\"" Jul 27 16:06:43.656929 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:43.656890 2561 generic.go:356] "Generic (PLEG): container finished" podID="7264bc03-3a2a-4c7f-92e9-29365a38ff72" containerID="b3ddfcfa9b3c75df6f6eeac6fcac13f29d5041aa3f0209da1b5819a83d6dc66c" exitCode=0 Jul 27 16:06:43.657342 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:43.656973 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-rpngz" Jul 27 16:06:43.657342 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:43.656981 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-rpngz" event={"ID":"7264bc03-3a2a-4c7f-92e9-29365a38ff72","Type":"ContainerDied","Data":"b3ddfcfa9b3c75df6f6eeac6fcac13f29d5041aa3f0209da1b5819a83d6dc66c"} Jul 27 16:06:43.657342 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:43.657052 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-rpngz" event={"ID":"7264bc03-3a2a-4c7f-92e9-29365a38ff72","Type":"ContainerDied","Data":"b41b18f6dd9bcb84300ca0ecd0c8c8147b3c4fe5a73bb425e3b2f8b4cbb55ba3"} Jul 27 16:06:43.657342 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:43.657084 2561 scope.go:117] "RemoveContainer" containerID="b3ddfcfa9b3c75df6f6eeac6fcac13f29d5041aa3f0209da1b5819a83d6dc66c" Jul 27 16:06:43.659205 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:43.659138 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cwcbw/must-gather-lqcfl" event={"ID":"d8d441b3-c732-4edc-bc12-6a261fd93d27","Type":"ContainerStarted","Data":"dad008e7ce1dbc3cd82e74ef6b34af1fd80ad7806d37250aa422142611759a45"} Jul 27 16:06:43.659205 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:43.659187 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cwcbw/must-gather-lqcfl" event={"ID":"d8d441b3-c732-4edc-bc12-6a261fd93d27","Type":"ContainerStarted","Data":"20208fbf10a5ffe7888a3872c0931409b5fc09f4a1edf24028146d1ad71160a4"} Jul 27 16:06:43.666729 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:43.666708 2561 scope.go:117] "RemoveContainer" containerID="b3ddfcfa9b3c75df6f6eeac6fcac13f29d5041aa3f0209da1b5819a83d6dc66c" Jul 27 16:06:43.667091 ip-10-0-142-4 kubenswrapper[2561]: E0727 16:06:43.667072 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3ddfcfa9b3c75df6f6eeac6fcac13f29d5041aa3f0209da1b5819a83d6dc66c\": container with ID starting with b3ddfcfa9b3c75df6f6eeac6fcac13f29d5041aa3f0209da1b5819a83d6dc66c not found: ID does not exist" containerID="b3ddfcfa9b3c75df6f6eeac6fcac13f29d5041aa3f0209da1b5819a83d6dc66c" Jul 27 16:06:43.667158 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:43.667104 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3ddfcfa9b3c75df6f6eeac6fcac13f29d5041aa3f0209da1b5819a83d6dc66c"} err="failed to get container status \"b3ddfcfa9b3c75df6f6eeac6fcac13f29d5041aa3f0209da1b5819a83d6dc66c\": rpc error: code = NotFound desc = could not find container \"b3ddfcfa9b3c75df6f6eeac6fcac13f29d5041aa3f0209da1b5819a83d6dc66c\": container with ID starting with b3ddfcfa9b3c75df6f6eeac6fcac13f29d5041aa3f0209da1b5819a83d6dc66c not found: ID does not exist" Jul 27 16:06:43.671624 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:43.671597 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-rpngz"] Jul 27 16:06:43.676232 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:43.676203 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-rpngz"] Jul 27 16:06:44.684162 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:44.684105 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-cwcbw/must-gather-lqcfl" podStartSLOduration=2.781821296 podStartE2EDuration="15.684085277s" totalImagesPullingTime="12.902263981s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:06:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:06:44.682401292 +0000 UTC m=+775.476127573" watchObservedRunningTime="2026-07-27 16:06:44.684085277 +0000 UTC m=+775.477811557" Jul 27 16:06:45.636245 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:06:45.636214 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7264bc03-3a2a-4c7f-92e9-29365a38ff72" path="/var/lib/kubelet/pods/7264bc03-3a2a-4c7f-92e9-29365a38ff72/volumes" Jul 27 16:07:06.366388 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:06.366348 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:07:20.475777 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:20.475690 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:07:31.888498 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:31.888462 2561 generic.go:356] "Generic (PLEG): container finished" podID="d8d441b3-c732-4edc-bc12-6a261fd93d27" containerID="20208fbf10a5ffe7888a3872c0931409b5fc09f4a1edf24028146d1ad71160a4" exitCode=0 Jul 27 16:07:31.888946 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:31.888535 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cwcbw/must-gather-lqcfl" event={"ID":"d8d441b3-c732-4edc-bc12-6a261fd93d27","Type":"ContainerDied","Data":"20208fbf10a5ffe7888a3872c0931409b5fc09f4a1edf24028146d1ad71160a4"} Jul 27 16:07:31.888946 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:31.888920 2561 scope.go:117] "RemoveContainer" containerID="20208fbf10a5ffe7888a3872c0931409b5fc09f4a1edf24028146d1ad71160a4" Jul 27 16:07:32.264310 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:32.264231 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-cwcbw_must-gather-lqcfl_d8d441b3-c732-4edc-bc12-6a261fd93d27/gather/0.log" Jul 27 16:07:32.668252 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:32.668209 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:07:32.822733 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:32.822695 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:07:32.918534 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:32.918438 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:07:35.708765 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:35.708728 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-v2tkp_db554c84-03a7-4127-8c5b-c7c18897237d/global-pull-secret-syncer/0.log" Jul 27 16:07:35.758642 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:35.758610 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" Jul 27 16:07:35.900859 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:35.900789 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-4.ec2.internal_fc7a2b8b8acfc7d700d26229752a314e/haproxy/0.log" Jul 27 16:07:37.640569 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:37.640539 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-cwcbw/must-gather-lqcfl"] Jul 27 16:07:37.641022 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:37.640721 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-cwcbw/must-gather-lqcfl" podUID="d8d441b3-c732-4edc-bc12-6a261fd93d27" containerName="copy" containerID="cri-o://dad008e7ce1dbc3cd82e74ef6b34af1fd80ad7806d37250aa422142611759a45" gracePeriod=2 Jul 27 16:07:37.645252 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:37.645221 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-cwcbw/must-gather-lqcfl"] Jul 27 16:07:37.877659 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:37.877638 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-cwcbw_must-gather-lqcfl_d8d441b3-c732-4edc-bc12-6a261fd93d27/copy/0.log" Jul 27 16:07:37.880315 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:37.880294 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cwcbw/must-gather-lqcfl" Jul 27 16:07:37.881794 ip-10-0-142-4 kubenswrapper[2561]: E0727 16:07:37.881770 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-lqcfl\" is forbidden: User \"system:node:ip-10-0-142-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-cwcbw\": no relationship found between node 'ip-10-0-142-4.ec2.internal' and this object" podUID="d8d441b3-c732-4edc-bc12-6a261fd93d27" pod="openshift-must-gather-cwcbw/must-gather-lqcfl" Jul 27 16:07:37.913876 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:37.913767 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-cwcbw_must-gather-lqcfl_d8d441b3-c732-4edc-bc12-6a261fd93d27/copy/0.log" Jul 27 16:07:37.914188 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:37.914157 2561 generic.go:356] "Generic (PLEG): container finished" podID="d8d441b3-c732-4edc-bc12-6a261fd93d27" containerID="dad008e7ce1dbc3cd82e74ef6b34af1fd80ad7806d37250aa422142611759a45" exitCode=143 Jul 27 16:07:37.914261 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:37.914217 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cwcbw/must-gather-lqcfl" Jul 27 16:07:37.914261 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:37.914227 2561 scope.go:117] "RemoveContainer" containerID="dad008e7ce1dbc3cd82e74ef6b34af1fd80ad7806d37250aa422142611759a45" Jul 27 16:07:37.917641 ip-10-0-142-4 kubenswrapper[2561]: E0727 16:07:37.917610 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-lqcfl\" is forbidden: User \"system:node:ip-10-0-142-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-cwcbw\": no relationship found between node 'ip-10-0-142-4.ec2.internal' and this object" podUID="d8d441b3-c732-4edc-bc12-6a261fd93d27" pod="openshift-must-gather-cwcbw/must-gather-lqcfl" Jul 27 16:07:37.922091 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:37.922070 2561 scope.go:117] "RemoveContainer" containerID="20208fbf10a5ffe7888a3872c0931409b5fc09f4a1edf24028146d1ad71160a4" Jul 27 16:07:37.934562 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:37.934544 2561 scope.go:117] "RemoveContainer" containerID="dad008e7ce1dbc3cd82e74ef6b34af1fd80ad7806d37250aa422142611759a45" Jul 27 16:07:37.934925 ip-10-0-142-4 kubenswrapper[2561]: E0727 16:07:37.934899 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dad008e7ce1dbc3cd82e74ef6b34af1fd80ad7806d37250aa422142611759a45\": container with ID starting with dad008e7ce1dbc3cd82e74ef6b34af1fd80ad7806d37250aa422142611759a45 not found: ID does not exist" containerID="dad008e7ce1dbc3cd82e74ef6b34af1fd80ad7806d37250aa422142611759a45" Jul 27 16:07:37.935003 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:37.934936 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dad008e7ce1dbc3cd82e74ef6b34af1fd80ad7806d37250aa422142611759a45"} err="failed to get container status \"dad008e7ce1dbc3cd82e74ef6b34af1fd80ad7806d37250aa422142611759a45\": rpc error: code = NotFound desc = could not find container \"dad008e7ce1dbc3cd82e74ef6b34af1fd80ad7806d37250aa422142611759a45\": container with ID starting with dad008e7ce1dbc3cd82e74ef6b34af1fd80ad7806d37250aa422142611759a45 not found: ID does not exist" Jul 27 16:07:37.935003 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:37.934957 2561 scope.go:117] "RemoveContainer" containerID="20208fbf10a5ffe7888a3872c0931409b5fc09f4a1edf24028146d1ad71160a4" Jul 27 16:07:37.935235 ip-10-0-142-4 kubenswrapper[2561]: E0727 16:07:37.935216 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20208fbf10a5ffe7888a3872c0931409b5fc09f4a1edf24028146d1ad71160a4\": container with ID starting with 20208fbf10a5ffe7888a3872c0931409b5fc09f4a1edf24028146d1ad71160a4 not found: ID does not exist" containerID="20208fbf10a5ffe7888a3872c0931409b5fc09f4a1edf24028146d1ad71160a4" Jul 27 16:07:37.935297 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:37.935259 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20208fbf10a5ffe7888a3872c0931409b5fc09f4a1edf24028146d1ad71160a4"} err="failed to get container status \"20208fbf10a5ffe7888a3872c0931409b5fc09f4a1edf24028146d1ad71160a4\": rpc error: code = NotFound desc = could not find container \"20208fbf10a5ffe7888a3872c0931409b5fc09f4a1edf24028146d1ad71160a4\": container with ID starting with 20208fbf10a5ffe7888a3872c0931409b5fc09f4a1edf24028146d1ad71160a4 not found: ID does not exist" Jul 27 16:07:37.992842 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:37.992780 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rk66g\" (UniqueName: \"kubernetes.io/projected/d8d441b3-c732-4edc-bc12-6a261fd93d27-kube-api-access-rk66g\") pod \"d8d441b3-c732-4edc-bc12-6a261fd93d27\" (UID: \"d8d441b3-c732-4edc-bc12-6a261fd93d27\") " Jul 27 16:07:37.993008 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:37.992870 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d8d441b3-c732-4edc-bc12-6a261fd93d27-must-gather-output\") pod \"d8d441b3-c732-4edc-bc12-6a261fd93d27\" (UID: \"d8d441b3-c732-4edc-bc12-6a261fd93d27\") " Jul 27 16:07:37.994160 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:37.994122 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8d441b3-c732-4edc-bc12-6a261fd93d27-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "d8d441b3-c732-4edc-bc12-6a261fd93d27" (UID: "d8d441b3-c732-4edc-bc12-6a261fd93d27"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 16:07:37.995046 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:37.995025 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8d441b3-c732-4edc-bc12-6a261fd93d27-kube-api-access-rk66g" (OuterVolumeSpecName: "kube-api-access-rk66g") pod "d8d441b3-c732-4edc-bc12-6a261fd93d27" (UID: "d8d441b3-c732-4edc-bc12-6a261fd93d27"). InnerVolumeSpecName "kube-api-access-rk66g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 16:07:38.094113 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:38.094072 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rk66g\" (UniqueName: \"kubernetes.io/projected/d8d441b3-c732-4edc-bc12-6a261fd93d27-kube-api-access-rk66g\") on node \"ip-10-0-142-4.ec2.internal\" DevicePath \"\"" Jul 27 16:07:38.094113 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:38.094103 2561 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d8d441b3-c732-4edc-bc12-6a261fd93d27-must-gather-output\") on node \"ip-10-0-142-4.ec2.internal\" DevicePath \"\"" Jul 27 16:07:38.224316 ip-10-0-142-4 kubenswrapper[2561]: E0727 16:07:38.224281 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-lqcfl\" is forbidden: User \"system:node:ip-10-0-142-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-cwcbw\": no relationship found between node 'ip-10-0-142-4.ec2.internal' and this object" podUID="d8d441b3-c732-4edc-bc12-6a261fd93d27" pod="openshift-must-gather-cwcbw/must-gather-lqcfl" Jul 27 16:07:38.458695 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:38.458658 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:07:38.511548 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:38.511455 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4l8tg_7299eae8-57e9-40fa-a73d-6ca4856375de/konnectivity-agent/0.log" limit=1024 Jul 27 16:07:39.405962 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:39.405934 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_aa3363ff-a6b6-42c8-817c-902048fe0ddb/alertmanager/0.log" Jul 27 16:07:39.434989 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:39.434946 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_aa3363ff-a6b6-42c8-817c-902048fe0ddb/config-reloader/0.log" Jul 27 16:07:39.472684 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:39.472659 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_aa3363ff-a6b6-42c8-817c-902048fe0ddb/kube-rbac-proxy-web/0.log" Jul 27 16:07:39.506924 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:39.506896 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_aa3363ff-a6b6-42c8-817c-902048fe0ddb/kube-rbac-proxy/0.log" Jul 27 16:07:39.543819 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:39.543765 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_aa3363ff-a6b6-42c8-817c-902048fe0ddb/kube-rbac-proxy-metric/0.log" Jul 27 16:07:39.571042 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:39.571011 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_aa3363ff-a6b6-42c8-817c-902048fe0ddb/prom-label-proxy/0.log" Jul 27 16:07:39.602683 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:39.602654 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_aa3363ff-a6b6-42c8-817c-902048fe0ddb/init-config-reloader/0.log" Jul 27 16:07:39.634689 ip-10-0-142-4 kubenswrapper[2561]: E0727 16:07:39.634649 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-lqcfl\" is forbidden: User \"system:node:ip-10-0-142-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-cwcbw\": no relationship found between node 'ip-10-0-142-4.ec2.internal' and this object" podUID="d8d441b3-c732-4edc-bc12-6a261fd93d27" pod="openshift-must-gather-cwcbw/must-gather-lqcfl" Jul 27 16:07:39.635557 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:39.635537 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8d441b3-c732-4edc-bc12-6a261fd93d27" path="/var/lib/kubelet/pods/d8d441b3-c732-4edc-bc12-6a261fd93d27/volumes" Jul 27 16:07:39.857999 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:39.857967 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-49r22_c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48/node-exporter/0.log" Jul 27 16:07:39.881234 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:39.881208 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-49r22_c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48/kube-rbac-proxy/0.log" Jul 27 16:07:39.911773 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:39.911747 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-49r22_c8f0eca3-bf2c-4a95-b1ed-dd3c3fe08d48/init-textfile/0.log" Jul 27 16:07:40.124705 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:40.124617 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-7hmhc_59e0da4c-9d6e-4a70-9803-74c95cadd303/kube-rbac-proxy-main/0.log" Jul 27 16:07:40.152767 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:40.152732 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-7hmhc_59e0da4c-9d6e-4a70-9803-74c95cadd303/kube-rbac-proxy-self/0.log" Jul 27 16:07:40.176850 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:40.176820 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-7hmhc_59e0da4c-9d6e-4a70-9803-74c95cadd303/openshift-state-metrics/0.log" Jul 27 16:07:40.611233 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:40.611201 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68c99b9449-k5x67_8ddb09a2-fc83-43d5-8e99-414dd6cda85e/thanos-query/0.log" Jul 27 16:07:40.645332 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:40.645305 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68c99b9449-k5x67_8ddb09a2-fc83-43d5-8e99-414dd6cda85e/kube-rbac-proxy-web/0.log" Jul 27 16:07:40.675324 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:40.675290 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68c99b9449-k5x67_8ddb09a2-fc83-43d5-8e99-414dd6cda85e/kube-rbac-proxy/0.log" Jul 27 16:07:40.703194 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:40.703162 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68c99b9449-k5x67_8ddb09a2-fc83-43d5-8e99-414dd6cda85e/prom-label-proxy/0.log" Jul 27 16:07:40.740786 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:40.740757 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68c99b9449-k5x67_8ddb09a2-fc83-43d5-8e99-414dd6cda85e/kube-rbac-proxy-rules/0.log" Jul 27 16:07:40.784201 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:40.784176 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68c99b9449-k5x67_8ddb09a2-fc83-43d5-8e99-414dd6cda85e/kube-rbac-proxy-metrics/0.log" Jul 27 16:07:42.989415 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:42.989386 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-7spc6_f3a0a6d1-3acb-4d47-a1b7-670e07c2fc6d/download-server/0.log" Jul 27 16:07:43.329706 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:43.329659 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zcbz5/perf-node-gather-daemonset-4477w"] Jul 27 16:07:43.330015 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:43.329998 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7264bc03-3a2a-4c7f-92e9-29365a38ff72" containerName="manager" Jul 27 16:07:43.330015 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:43.330015 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7264bc03-3a2a-4c7f-92e9-29365a38ff72" containerName="manager" Jul 27 16:07:43.330144 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:43.330034 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8d441b3-c732-4edc-bc12-6a261fd93d27" containerName="gather" Jul 27 16:07:43.330144 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:43.330040 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8d441b3-c732-4edc-bc12-6a261fd93d27" containerName="gather" Jul 27 16:07:43.330144 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:43.330052 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8d441b3-c732-4edc-bc12-6a261fd93d27" containerName="copy" Jul 27 16:07:43.330144 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:43.330058 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8d441b3-c732-4edc-bc12-6a261fd93d27" containerName="copy" Jul 27 16:07:43.330144 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:43.330103 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8d441b3-c732-4edc-bc12-6a261fd93d27" containerName="copy" Jul 27 16:07:43.330144 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:43.330112 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="7264bc03-3a2a-4c7f-92e9-29365a38ff72" containerName="manager" Jul 27 16:07:43.330144 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:43.330118 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8d441b3-c732-4edc-bc12-6a261fd93d27" containerName="gather" Jul 27 16:07:43.335213 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:43.335195 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zcbz5/perf-node-gather-daemonset-4477w" Jul 27 16:07:43.337192 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:43.337171 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-zcbz5\"/\"default-dockercfg-thx2p\"" Jul 27 16:07:43.337324 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:43.337196 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zcbz5\"/\"kube-root-ca.crt\"" Jul 27 16:07:43.337537 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:43.337520 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zcbz5\"/\"openshift-service-ca.crt\"" Jul 27 16:07:43.343135 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:43.343113 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zcbz5/perf-node-gather-daemonset-4477w"] Jul 27 16:07:43.438157 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:43.438119 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a340f41c-affd-4009-b532-1370a01c1382-sys\") pod \"perf-node-gather-daemonset-4477w\" (UID: \"a340f41c-affd-4009-b532-1370a01c1382\") " pod="openshift-must-gather-zcbz5/perf-node-gather-daemonset-4477w" Jul 27 16:07:43.438369 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:43.438172 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdc9f\" (UniqueName: \"kubernetes.io/projected/a340f41c-affd-4009-b532-1370a01c1382-kube-api-access-bdc9f\") pod \"perf-node-gather-daemonset-4477w\" (UID: \"a340f41c-affd-4009-b532-1370a01c1382\") " pod="openshift-must-gather-zcbz5/perf-node-gather-daemonset-4477w" Jul 27 16:07:43.438369 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:43.438276 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a340f41c-affd-4009-b532-1370a01c1382-proc\") pod \"perf-node-gather-daemonset-4477w\" (UID: \"a340f41c-affd-4009-b532-1370a01c1382\") " pod="openshift-must-gather-zcbz5/perf-node-gather-daemonset-4477w" Jul 27 16:07:43.438369 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:43.438302 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a340f41c-affd-4009-b532-1370a01c1382-podres\") pod \"perf-node-gather-daemonset-4477w\" (UID: \"a340f41c-affd-4009-b532-1370a01c1382\") " pod="openshift-must-gather-zcbz5/perf-node-gather-daemonset-4477w" Jul 27 16:07:43.438369 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:43.438325 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a340f41c-affd-4009-b532-1370a01c1382-lib-modules\") pod \"perf-node-gather-daemonset-4477w\" (UID: \"a340f41c-affd-4009-b532-1370a01c1382\") " pod="openshift-must-gather-zcbz5/perf-node-gather-daemonset-4477w" Jul 27 16:07:43.539010 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:43.538969 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a340f41c-affd-4009-b532-1370a01c1382-proc\") pod \"perf-node-gather-daemonset-4477w\" (UID: \"a340f41c-affd-4009-b532-1370a01c1382\") " pod="openshift-must-gather-zcbz5/perf-node-gather-daemonset-4477w" Jul 27 16:07:43.539010 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:43.539014 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a340f41c-affd-4009-b532-1370a01c1382-podres\") pod \"perf-node-gather-daemonset-4477w\" (UID: \"a340f41c-affd-4009-b532-1370a01c1382\") " pod="openshift-must-gather-zcbz5/perf-node-gather-daemonset-4477w" Jul 27 16:07:43.539247 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:43.539036 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a340f41c-affd-4009-b532-1370a01c1382-lib-modules\") pod \"perf-node-gather-daemonset-4477w\" (UID: \"a340f41c-affd-4009-b532-1370a01c1382\") " pod="openshift-must-gather-zcbz5/perf-node-gather-daemonset-4477w" Jul 27 16:07:43.539247 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:43.539086 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a340f41c-affd-4009-b532-1370a01c1382-sys\") pod \"perf-node-gather-daemonset-4477w\" (UID: \"a340f41c-affd-4009-b532-1370a01c1382\") " pod="openshift-must-gather-zcbz5/perf-node-gather-daemonset-4477w" Jul 27 16:07:43.539247 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:43.539104 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a340f41c-affd-4009-b532-1370a01c1382-proc\") pod \"perf-node-gather-daemonset-4477w\" (UID: \"a340f41c-affd-4009-b532-1370a01c1382\") " pod="openshift-must-gather-zcbz5/perf-node-gather-daemonset-4477w" Jul 27 16:07:43.539247 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:43.539117 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdc9f\" (UniqueName: \"kubernetes.io/projected/a340f41c-affd-4009-b532-1370a01c1382-kube-api-access-bdc9f\") pod \"perf-node-gather-daemonset-4477w\" (UID: \"a340f41c-affd-4009-b532-1370a01c1382\") " pod="openshift-must-gather-zcbz5/perf-node-gather-daemonset-4477w" Jul 27 16:07:43.539247 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:43.539153 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a340f41c-affd-4009-b532-1370a01c1382-podres\") pod \"perf-node-gather-daemonset-4477w\" (UID: \"a340f41c-affd-4009-b532-1370a01c1382\") " pod="openshift-must-gather-zcbz5/perf-node-gather-daemonset-4477w" Jul 27 16:07:43.539247 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:43.539201 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a340f41c-affd-4009-b532-1370a01c1382-sys\") pod \"perf-node-gather-daemonset-4477w\" (UID: \"a340f41c-affd-4009-b532-1370a01c1382\") " pod="openshift-must-gather-zcbz5/perf-node-gather-daemonset-4477w" Jul 27 16:07:43.539247 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:43.539233 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a340f41c-affd-4009-b532-1370a01c1382-lib-modules\") pod \"perf-node-gather-daemonset-4477w\" (UID: \"a340f41c-affd-4009-b532-1370a01c1382\") " pod="openshift-must-gather-zcbz5/perf-node-gather-daemonset-4477w" Jul 27 16:07:43.547642 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:43.547616 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdc9f\" (UniqueName: \"kubernetes.io/projected/a340f41c-affd-4009-b532-1370a01c1382-kube-api-access-bdc9f\") pod \"perf-node-gather-daemonset-4477w\" (UID: \"a340f41c-affd-4009-b532-1370a01c1382\") " pod="openshift-must-gather-zcbz5/perf-node-gather-daemonset-4477w" Jul 27 16:07:43.645868 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:43.645771 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zcbz5/perf-node-gather-daemonset-4477w" Jul 27 16:07:43.777705 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:43.777673 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zcbz5/perf-node-gather-daemonset-4477w"] Jul 27 16:07:43.780752 ip-10-0-142-4 kubenswrapper[2561]: W0727 16:07:43.780722 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda340f41c_affd_4009_b532_1370a01c1382.slice/crio-1f77e6ade1a66e17586981d5e66681943fd4dba0e4e51049517c795dd12fa580 WatchSource:0}: Error finding container 1f77e6ade1a66e17586981d5e66681943fd4dba0e4e51049517c795dd12fa580: Status 404 returned error can't find the container with id 1f77e6ade1a66e17586981d5e66681943fd4dba0e4e51049517c795dd12fa580 Jul 27 16:07:43.940478 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:43.940393 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zcbz5/perf-node-gather-daemonset-4477w" event={"ID":"a340f41c-affd-4009-b532-1370a01c1382","Type":"ContainerStarted","Data":"ed76f15a84f10b3ee5bbc8b04543d81f0ab415ffa5cf4ad10e8001b1f6c58128"} Jul 27 16:07:43.940478 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:43.940470 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zcbz5/perf-node-gather-daemonset-4477w" event={"ID":"a340f41c-affd-4009-b532-1370a01c1382","Type":"ContainerStarted","Data":"1f77e6ade1a66e17586981d5e66681943fd4dba0e4e51049517c795dd12fa580"} Jul 27 16:07:43.940675 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:43.940545 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-zcbz5/perf-node-gather-daemonset-4477w" Jul 27 16:07:44.668909 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:44.668862 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z6kjm_709e3495-04dc-42d1-bf57-d706479934c3/dns/0.log" Jul 27 16:07:44.694916 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:44.694884 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z6kjm_709e3495-04dc-42d1-bf57-d706479934c3/kube-rbac-proxy/0.log" Jul 27 16:07:44.781777 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:44.781748 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zf9cg_8d8db91e-5711-4fa5-af72-baa451e66451/dns-node-resolver/0.log" Jul 27 16:07:45.257250 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:45.257209 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-62j4b_aadbe564-2de9-44b9-b409-b190bc6f4a26/node-ca/0.log" Jul 27 16:07:46.514342 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:46.514313 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r6vrq_84071b3f-3bb3-4ce6-8309-95cb35d245ad/serve-healthcheck-canary/0.log" Jul 27 16:07:47.101294 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:47.101266 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x2m5m_7d1324c9-b8ce-4851-afdc-bbeb88355160/kube-rbac-proxy/0.log" Jul 27 16:07:47.127709 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:47.127676 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x2m5m_7d1324c9-b8ce-4851-afdc-bbeb88355160/exporter/0.log" Jul 27 16:07:47.153747 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:47.153714 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x2m5m_7d1324c9-b8ce-4851-afdc-bbeb88355160/extractor/0.log" Jul 27 16:07:49.954696 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:49.954620 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-zcbz5/perf-node-gather-daemonset-4477w" Jul 27 16:07:49.971967 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:49.971913 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-zcbz5/perf-node-gather-daemonset-4477w" podStartSLOduration=6.971897092 podStartE2EDuration="6.971897092s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 16:07:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:07:43.971949385 +0000 UTC m=+834.765675664" watchObservedRunningTime="2026-07-27 16:07:49.971897092 +0000 UTC m=+840.765623730" Jul 27 16:07:54.058110 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:54.058076 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7nsnh_dd45f717-ad83-4aad-ba24-2b77778ff926/kube-multus/0.log" Jul 27 16:07:54.519639 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:54.519613 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tzdrq_a28e8365-5281-405d-aa55-bc4ff9a8b671/kube-multus-additional-cni-plugins/0.log" Jul 27 16:07:54.546564 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:54.546537 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tzdrq_a28e8365-5281-405d-aa55-bc4ff9a8b671/egress-router-binary-copy/0.log" Jul 27 16:07:54.576504 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:54.576428 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tzdrq_a28e8365-5281-405d-aa55-bc4ff9a8b671/cni-plugins/0.log" Jul 27 16:07:54.601010 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:54.600922 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tzdrq_a28e8365-5281-405d-aa55-bc4ff9a8b671/bond-cni-plugin/0.log" Jul 27 16:07:54.624459 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:54.624430 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tzdrq_a28e8365-5281-405d-aa55-bc4ff9a8b671/routeoverride-cni/0.log" Jul 27 16:07:54.647305 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:54.647278 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tzdrq_a28e8365-5281-405d-aa55-bc4ff9a8b671/whereabouts-cni-bincopy/0.log" Jul 27 16:07:54.671195 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:54.671165 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tzdrq_a28e8365-5281-405d-aa55-bc4ff9a8b671/whereabouts-cni/0.log" Jul 27 16:07:54.839704 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:54.839627 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vpk45_2875ea72-06f8-4c75-b39b-2524b82f6875/network-metrics-daemon/0.log" Jul 27 16:07:54.865885 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:54.865857 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vpk45_2875ea72-06f8-4c75-b39b-2524b82f6875/kube-rbac-proxy/0.log" Jul 27 16:07:55.667403 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:55.667370 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mnsv_4110ede3-5c49-41c8-90d7-091cbc5def4a/ovn-controller/0.log" Jul 27 16:07:55.692737 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:55.692686 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mnsv_4110ede3-5c49-41c8-90d7-091cbc5def4a/ovn-acl-logging/0.log" Jul 27 16:07:55.725952 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:55.725925 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mnsv_4110ede3-5c49-41c8-90d7-091cbc5def4a/kube-rbac-proxy-node/0.log" Jul 27 16:07:55.760345 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:55.760316 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mnsv_4110ede3-5c49-41c8-90d7-091cbc5def4a/kube-rbac-proxy-ovn-metrics/0.log" Jul 27 16:07:55.783139 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:55.783109 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mnsv_4110ede3-5c49-41c8-90d7-091cbc5def4a/northd/0.log" Jul 27 16:07:55.808105 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:55.808075 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mnsv_4110ede3-5c49-41c8-90d7-091cbc5def4a/nbdb/0.log" Jul 27 16:07:55.830402 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:55.830358 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mnsv_4110ede3-5c49-41c8-90d7-091cbc5def4a/sbdb/0.log" Jul 27 16:07:55.890354 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:55.890323 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mnsv_4110ede3-5c49-41c8-90d7-091cbc5def4a/ovnkube-controller/0.log" Jul 27 16:07:57.528360 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:57.528331 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-6khtd_26984101-b8ab-4b8c-9272-2cc91f0e2ee9/network-check-target-container/0.log" Jul 27 16:07:58.592199 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:58.592166 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-29p88_c363121b-53af-4035-86d4-b535c823d3c4/iptables-alerter/0.log" Jul 27 16:07:59.474716 ip-10-0-142-4 kubenswrapper[2561]: I0727 16:07:59.474687 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-t7xdc_ef66b9ac-f5a8-4538-ae4b-8c0b56e17cff/tuned/0.log"