Jul 06 21:02:25.074780 ip-10-0-131-182 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 06 21:02:25.074793 ip-10-0-131-182 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 06 21:02:25.074802 ip-10-0-131-182 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 06 21:02:25.075107 ip-10-0-131-182 systemd[1]: Failed to start Kubernetes Kubelet. Jul 06 21:02:35.088336 ip-10-0-131-182 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 06 21:02:35.088350 ip-10-0-131-182 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 15c0bd81f68548e7afad42bb8a878b5f -- Jul 06 21:04:12.363744 ip-10-0-131-182 systemd[1]: Starting Kubernetes Kubelet... Jul 06 21:04:12.837611 ip-10-0-131-182 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 21:04:12.837611 ip-10-0-131-182 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 21:04:12.837611 ip-10-0-131-182 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 21:04:12.837611 ip-10-0-131-182 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 21:04:12.837611 ip-10-0-131-182 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 21:04:12.837611 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.799947 2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 21:04:12.837611 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804103 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 21:04:12.837611 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804115 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 21:04:12.837611 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804118 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 21:04:12.837611 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804121 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 21:04:12.837611 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804125 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 21:04:12.837611 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804128 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 21:04:12.837611 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804131 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 21:04:12.837611 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804135 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 21:04:12.848141 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804138 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 21:04:12.848141 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804142 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 21:04:12.848141 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804145 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 21:04:12.848141 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804148 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 21:04:12.848141 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804152 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 21:04:12.848141 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804156 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 21:04:12.848141 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804167 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 21:04:12.848141 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804170 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 21:04:12.848141 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804173 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 21:04:12.848141 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804176 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 21:04:12.848141 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804179 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 21:04:12.848141 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804183 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 21:04:12.848141 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804186 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 21:04:12.848141 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804190 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 21:04:12.848141 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804193 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 06 21:04:12.848141 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804196 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 21:04:12.848141 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804199 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 21:04:12.848141 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804202 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 21:04:12.848141 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804205 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 21:04:12.850709 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804208 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 21:04:12.850709 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804210 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 21:04:12.850709 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804213 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 21:04:12.850709 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804216 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 21:04:12.850709 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804218 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 21:04:12.850709 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804221 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 21:04:12.850709 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804224 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 21:04:12.850709 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804226 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 21:04:12.850709 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804229 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 21:04:12.850709 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804232 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 21:04:12.850709 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804234 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 21:04:12.850709 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804237 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 21:04:12.850709 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804239 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 21:04:12.850709 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804243 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 21:04:12.850709 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804246 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 21:04:12.850709 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804249 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 21:04:12.850709 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804252 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 21:04:12.850709 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804255 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 21:04:12.850709 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804258 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 21:04:12.850709 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804260 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 21:04:12.856749 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804263 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 21:04:12.856749 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804266 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 21:04:12.856749 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804268 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 21:04:12.856749 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804270 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 21:04:12.856749 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804273 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 21:04:12.856749 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804275 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 21:04:12.856749 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804278 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 21:04:12.856749 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804281 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 21:04:12.856749 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804283 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 21:04:12.856749 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804286 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 21:04:12.856749 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804288 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 21:04:12.856749 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804291 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 21:04:12.856749 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804294 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 21:04:12.856749 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804297 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 21:04:12.856749 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804299 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 21:04:12.856749 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804302 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 21:04:12.856749 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804305 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 21:04:12.856749 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804308 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 21:04:12.856749 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804310 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 21:04:12.856749 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804313 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 21:04:12.889696 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804316 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 21:04:12.889696 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804318 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 21:04:12.889696 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804322 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 21:04:12.889696 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804324 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 21:04:12.889696 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804329 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 21:04:12.889696 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804332 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 21:04:12.889696 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804336 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 21:04:12.889696 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804339 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 21:04:12.889696 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804341 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 21:04:12.889696 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804344 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 21:04:12.889696 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804346 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 21:04:12.889696 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804349 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 21:04:12.889696 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804351 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 21:04:12.889696 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804354 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 21:04:12.889696 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804357 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 21:04:12.889696 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804359 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 21:04:12.889696 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804362 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 21:04:12.889696 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804364 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 21:04:12.889696 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804367 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 21:04:12.893409 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804369 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 21:04:12.893409 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804372 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 21:04:12.893409 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804374 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 21:04:12.893409 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804377 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 21:04:12.893409 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804380 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 21:04:12.893409 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804383 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 21:04:12.893409 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804385 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 21:04:12.893409 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804388 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 21:04:12.893409 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804390 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 21:04:12.893409 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804392 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 21:04:12.893409 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804395 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 21:04:12.893409 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804400 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 21:04:12.893409 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.804402 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 21:04:12.893409 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805127 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 21:04:12.893409 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805133 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 21:04:12.893409 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805136 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 21:04:12.893409 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805138 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 21:04:12.893409 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805141 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 21:04:12.893409 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805144 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 21:04:12.893409 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805146 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 21:04:12.893409 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805149 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 21:04:12.887967 ip-10-0-131-182 systemd[1]: Started Kubernetes Kubelet. Jul 06 21:04:12.897753 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805154 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 21:04:12.897753 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805158 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 21:04:12.897753 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805162 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 21:04:12.897753 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805165 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 21:04:12.897753 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805168 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 21:04:12.897753 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805171 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 21:04:12.897753 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805174 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 21:04:12.897753 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805177 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 21:04:12.897753 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805179 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 21:04:12.897753 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805182 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 21:04:12.897753 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805184 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 21:04:12.897753 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805187 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 21:04:12.897753 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805189 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 21:04:12.897753 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805192 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 21:04:12.897753 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805194 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 21:04:12.897753 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805197 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 21:04:12.897753 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805199 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 21:04:12.897753 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805202 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 21:04:12.897753 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805204 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 21:04:12.908577 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805207 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 21:04:12.908577 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805209 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 21:04:12.908577 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805212 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 21:04:12.908577 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805217 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 21:04:12.908577 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805221 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 21:04:12.908577 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805224 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 21:04:12.908577 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805227 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 21:04:12.908577 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805229 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 21:04:12.908577 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805232 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 21:04:12.908577 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805235 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 21:04:12.908577 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805238 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 21:04:12.908577 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805241 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 21:04:12.908577 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805243 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 21:04:12.908577 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805246 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 21:04:12.908577 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805249 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 21:04:12.908577 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805254 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 21:04:12.908577 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805256 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 21:04:12.908577 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805259 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 21:04:12.908577 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805262 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 21:04:12.912689 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805264 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 21:04:12.912689 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805267 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 21:04:12.912689 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805270 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 21:04:12.912689 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805272 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 21:04:12.912689 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805275 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 21:04:12.912689 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805277 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 06 21:04:12.912689 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805280 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 21:04:12.912689 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805283 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 21:04:12.912689 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805287 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 21:04:12.912689 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805290 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 21:04:12.912689 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805293 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 21:04:12.912689 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805296 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 21:04:12.912689 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805298 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 21:04:12.912689 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805301 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 21:04:12.912689 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805303 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 21:04:12.912689 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805306 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 21:04:12.912689 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805309 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 21:04:12.912689 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805312 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 21:04:12.912689 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805314 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 21:04:12.917035 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805317 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 21:04:12.917035 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805319 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 21:04:12.917035 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805322 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 21:04:12.917035 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805324 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 21:04:12.917035 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805327 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 21:04:12.917035 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805329 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 21:04:12.917035 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805332 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 21:04:12.917035 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805334 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 21:04:12.917035 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805337 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 21:04:12.917035 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805340 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 21:04:12.917035 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805342 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 21:04:12.917035 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805345 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 21:04:12.917035 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805348 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 21:04:12.917035 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805350 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 21:04:12.917035 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805354 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 21:04:12.917035 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805357 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 21:04:12.917035 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805360 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 21:04:12.917035 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805363 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 21:04:12.917035 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805365 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 21:04:12.917035 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805368 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 21:04:13.090379 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805370 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 21:04:13.090379 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805373 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 21:04:13.090379 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805375 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 21:04:13.090379 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805378 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 21:04:13.090379 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805380 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 21:04:13.090379 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805383 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 21:04:13.090379 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805386 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 21:04:13.090379 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805388 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 21:04:13.090379 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805391 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 21:04:13.090379 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805394 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 21:04:13.090379 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805397 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 21:04:13.090379 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805399 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 21:04:13.090379 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805402 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 21:04:13.090379 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805404 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 21:04:13.090379 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805796 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 21:04:13.090379 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805801 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 21:04:13.090379 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805804 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 21:04:13.090379 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805806 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 21:04:13.090379 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805809 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 21:04:13.090379 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805812 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 06 21:04:13.107208 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805816 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 21:04:13.107208 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805819 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 21:04:13.107208 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805822 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 21:04:13.107208 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805825 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 21:04:13.107208 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805828 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 21:04:13.107208 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805831 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 21:04:13.107208 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805833 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 21:04:13.107208 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805836 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 21:04:13.107208 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805838 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 21:04:13.107208 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805841 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 21:04:13.107208 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805843 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 21:04:13.107208 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805846 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 21:04:13.107208 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805848 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 21:04:13.107208 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805851 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 21:04:13.107208 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805853 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 21:04:13.107208 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805856 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 21:04:13.107208 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805858 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 21:04:13.107208 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805861 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 21:04:13.107208 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805863 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 21:04:13.107208 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805866 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 21:04:13.124726 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805869 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 21:04:13.124726 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805875 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 21:04:13.124726 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805877 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 21:04:13.124726 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805880 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 21:04:13.124726 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805882 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 21:04:13.124726 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805885 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 21:04:13.124726 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805888 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 21:04:13.124726 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805890 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 21:04:13.124726 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805893 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 21:04:13.124726 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805895 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 21:04:13.124726 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805898 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 21:04:13.124726 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805900 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 21:04:13.124726 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805904 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 21:04:13.124726 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805906 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 21:04:13.124726 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805916 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 21:04:13.124726 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805918 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 21:04:13.124726 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805921 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 21:04:13.124726 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805923 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 21:04:13.124726 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805927 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 21:04:13.124726 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805931 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 21:04:13.125481 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805934 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 21:04:13.125481 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805937 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 21:04:13.125481 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805939 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 21:04:13.125481 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805942 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 21:04:13.125481 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805944 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 21:04:13.125481 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805947 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 21:04:13.125481 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805949 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 21:04:13.125481 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805952 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 21:04:13.125481 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805954 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 21:04:13.125481 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805957 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 21:04:13.125481 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805959 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 21:04:13.125481 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805962 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 21:04:13.125481 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805964 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 21:04:13.125481 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805969 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 21:04:13.125481 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805971 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 21:04:13.125481 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805974 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 21:04:13.125481 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805976 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 21:04:13.125481 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805979 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 21:04:13.125481 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805981 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 21:04:13.128782 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805984 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 21:04:13.128782 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805988 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 21:04:13.128782 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805991 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 21:04:13.128782 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805994 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 21:04:13.128782 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805996 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 21:04:13.128782 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.805999 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 21:04:13.128782 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806002 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 21:04:13.128782 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806005 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 21:04:13.128782 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806008 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 21:04:13.128782 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806010 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 21:04:13.128782 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806013 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 21:04:13.128782 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806015 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 21:04:13.128782 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806018 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 21:04:13.128782 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806020 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 21:04:13.128782 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806023 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 21:04:13.128782 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806025 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 21:04:13.128782 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806030 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 21:04:13.128782 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806033 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 21:04:13.128782 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806036 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 21:04:13.129805 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806039 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 21:04:13.129805 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806042 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 21:04:13.129805 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806045 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 21:04:13.129805 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806047 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 21:04:13.129805 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806050 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 21:04:13.129805 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806053 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 21:04:13.129805 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806056 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 21:04:13.129805 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806059 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 21:04:13.129805 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806062 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 21:04:13.129805 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806066 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 21:04:13.129805 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806069 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 21:04:13.129805 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806072 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 21:04:13.129805 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806075 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 21:04:13.129805 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806078 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 21:04:13.129805 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806080 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 21:04:13.129805 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806151 2563 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 21:04:13.129805 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806158 2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 21:04:13.129805 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806163 2563 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 21:04:13.129805 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806171 2563 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 21:04:13.129805 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806175 2563 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 21:04:13.129805 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806179 2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 21:04:13.130885 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806182 2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 21:04:13.130885 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806187 2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 21:04:13.130885 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806190 2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 21:04:13.130885 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806193 2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 21:04:13.130885 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806196 2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 21:04:13.130885 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806200 2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 21:04:13.130885 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806203 2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 21:04:13.130885 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806206 2563 flags.go:64] FLAG: --cgroup-root="" Jul 06 21:04:13.130885 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806209 2563 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 21:04:13.130885 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806211 2563 flags.go:64] FLAG: --client-ca-file="" Jul 06 21:04:13.130885 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806214 2563 flags.go:64] FLAG: --cloud-provider="external" Jul 06 21:04:13.130885 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806217 2563 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 21:04:13.130885 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806222 2563 flags.go:64] FLAG: --cluster-domain="" Jul 06 21:04:13.130885 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806225 2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 21:04:13.130885 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806228 2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 21:04:13.130885 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806231 2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 21:04:13.130885 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806234 2563 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 21:04:13.130885 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806238 2563 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 21:04:13.130885 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806242 2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 21:04:13.130885 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806245 2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 21:04:13.130885 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806249 2563 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 21:04:13.130885 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806251 2563 flags.go:64] FLAG: --contention-profiling="false" Jul 06 21:04:13.130885 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806254 2563 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 21:04:13.130885 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806257 2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 21:04:13.132408 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806261 2563 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 21:04:13.132408 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806278 2563 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 21:04:13.132408 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806284 2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 21:04:13.132408 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806288 2563 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 21:04:13.132408 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806291 2563 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 21:04:13.132408 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806296 2563 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 21:04:13.132408 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806299 2563 flags.go:64] FLAG: --enable-server="true" Jul 06 21:04:13.132408 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806302 2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 21:04:13.132408 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806306 2563 flags.go:64] FLAG: --event-burst="100" Jul 06 21:04:13.132408 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806309 2563 flags.go:64] FLAG: --event-qps="50" Jul 06 21:04:13.132408 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806312 2563 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 21:04:13.132408 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806316 2563 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 21:04:13.132408 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806319 2563 flags.go:64] FLAG: --eviction-hard="" Jul 06 21:04:13.132408 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806323 2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 21:04:13.132408 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806326 2563 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 21:04:13.132408 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806329 2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 21:04:13.132408 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806331 2563 flags.go:64] FLAG: --eviction-soft="" Jul 06 21:04:13.132408 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806334 2563 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 21:04:13.132408 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806337 2563 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 21:04:13.132408 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806340 2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 21:04:13.132408 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806344 2563 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 21:04:13.132408 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806346 2563 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 21:04:13.132408 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806349 2563 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 21:04:13.132408 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806352 2563 flags.go:64] FLAG: --feature-gates="" Jul 06 21:04:13.132408 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806356 2563 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 21:04:13.133950 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806359 2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 21:04:13.133950 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806363 2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 21:04:13.133950 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806366 2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 21:04:13.133950 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806369 2563 flags.go:64] FLAG: --healthz-port="10248" Jul 06 21:04:13.133950 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806372 2563 flags.go:64] FLAG: --help="false" Jul 06 21:04:13.133950 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806375 2563 flags.go:64] FLAG: --hostname-override="ip-10-0-131-182.ec2.internal" Jul 06 21:04:13.133950 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806378 2563 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 21:04:13.133950 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806381 2563 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 21:04:13.133950 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806384 2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 21:04:13.133950 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806388 2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 21:04:13.133950 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806391 2563 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 21:04:13.133950 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806394 2563 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 21:04:13.133950 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806398 2563 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 21:04:13.133950 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806401 2563 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 21:04:13.133950 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806403 2563 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 21:04:13.133950 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806406 2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 21:04:13.133950 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806409 2563 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 21:04:13.133950 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806412 2563 flags.go:64] FLAG: --kube-reserved="" Jul 06 21:04:13.133950 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806416 2563 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 21:04:13.133950 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806419 2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 21:04:13.133950 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806422 2563 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 21:04:13.133950 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806425 2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 21:04:13.133950 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806428 2563 flags.go:64] FLAG: --lock-file="" Jul 06 21:04:13.133950 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806430 2563 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 21:04:13.135409 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806433 2563 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 21:04:13.135409 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806436 2563 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 21:04:13.135409 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806441 2563 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 21:04:13.135409 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806444 2563 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 21:04:13.135409 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806447 2563 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 21:04:13.135409 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806450 2563 flags.go:64] FLAG: --logging-format="text" Jul 06 21:04:13.135409 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806453 2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 21:04:13.135409 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806456 2563 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 21:04:13.135409 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806471 2563 flags.go:64] FLAG: --manifest-url="" Jul 06 21:04:13.135409 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806477 2563 flags.go:64] FLAG: --manifest-url-header="" Jul 06 21:04:13.135409 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806482 2563 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 21:04:13.135409 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806485 2563 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 21:04:13.135409 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806493 2563 flags.go:64] FLAG: --max-pods="110" Jul 06 21:04:13.135409 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806496 2563 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 21:04:13.135409 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806499 2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 21:04:13.135409 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806502 2563 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 21:04:13.135409 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806505 2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 21:04:13.135409 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806508 2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 21:04:13.135409 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806510 2563 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 21:04:13.135409 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806513 2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 21:04:13.135409 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806521 2563 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 21:04:13.135409 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806524 2563 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 21:04:13.135409 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806527 2563 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 21:04:13.135409 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806530 2563 flags.go:64] FLAG: --pod-cidr="" Jul 06 21:04:13.136455 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806533 2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 21:04:13.136455 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806539 2563 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 21:04:13.136455 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806541 2563 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 21:04:13.136455 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806545 2563 flags.go:64] FLAG: --pods-per-core="0" Jul 06 21:04:13.136455 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806548 2563 flags.go:64] FLAG: --port="10250" Jul 06 21:04:13.136455 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806552 2563 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 21:04:13.136455 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806554 2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04d0d6e0a77d9fe34" Jul 06 21:04:13.136455 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806558 2563 flags.go:64] FLAG: --qos-reserved="" Jul 06 21:04:13.136455 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806561 2563 flags.go:64] FLAG: --read-only-port="10255" Jul 06 21:04:13.136455 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806563 2563 flags.go:64] FLAG: --register-node="true" Jul 06 21:04:13.136455 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806566 2563 flags.go:64] FLAG: --register-with-taints="" Jul 06 21:04:13.136455 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806570 2563 flags.go:64] FLAG: --registry-burst="10" Jul 06 21:04:13.136455 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806573 2563 flags.go:64] FLAG: --registry-qps="5" Jul 06 21:04:13.136455 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806576 2563 flags.go:64] FLAG: --reserved-cpus="" Jul 06 21:04:13.136455 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806579 2563 flags.go:64] FLAG: --reserved-memory="" Jul 06 21:04:13.136455 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806582 2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 21:04:13.136455 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806585 2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 21:04:13.136455 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806589 2563 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 21:04:13.136455 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806592 2563 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 21:04:13.136455 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806595 2563 flags.go:64] FLAG: --runonce="false" Jul 06 21:04:13.136455 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806597 2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 21:04:13.136455 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806601 2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 21:04:13.136455 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806604 2563 flags.go:64] FLAG: --seccomp-default="false" Jul 06 21:04:13.136455 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806606 2563 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 21:04:13.136455 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806609 2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 21:04:13.137998 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806612 2563 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 21:04:13.137998 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806615 2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 21:04:13.137998 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806618 2563 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 21:04:13.137998 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806621 2563 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 21:04:13.137998 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806625 2563 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 21:04:13.137998 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806628 2563 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 21:04:13.137998 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806630 2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 21:04:13.137998 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806634 2563 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 21:04:13.137998 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806637 2563 flags.go:64] FLAG: --system-cgroups="" Jul 06 21:04:13.137998 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806640 2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 21:04:13.137998 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806645 2563 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 21:04:13.137998 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806649 2563 flags.go:64] FLAG: --tls-cert-file="" Jul 06 21:04:13.137998 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806651 2563 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 21:04:13.137998 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806656 2563 flags.go:64] FLAG: --tls-min-version="" Jul 06 21:04:13.137998 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806659 2563 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 21:04:13.137998 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806661 2563 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 21:04:13.137998 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806664 2563 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 21:04:13.137998 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806667 2563 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 21:04:13.137998 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806670 2563 flags.go:64] FLAG: --v="2" Jul 06 21:04:13.137998 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806674 2563 flags.go:64] FLAG: --version="false" Jul 06 21:04:13.137998 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806678 2563 flags.go:64] FLAG: --vmodule="" Jul 06 21:04:13.137998 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806682 2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 21:04:13.137998 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.806685 2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 21:04:13.137998 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806798 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 21:04:13.137998 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806803 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 21:04:13.139433 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806806 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 21:04:13.139433 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806809 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 21:04:13.139433 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806812 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 21:04:13.139433 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806815 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 21:04:13.139433 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806817 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 21:04:13.139433 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806820 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 21:04:13.139433 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806822 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 21:04:13.139433 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806824 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 21:04:13.139433 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806827 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 21:04:13.139433 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806829 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 21:04:13.139433 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806832 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 21:04:13.139433 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806836 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 21:04:13.139433 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806838 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 21:04:13.139433 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806841 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 21:04:13.139433 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806844 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 21:04:13.139433 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806847 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 21:04:13.139433 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806849 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 21:04:13.139433 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806852 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 21:04:13.139433 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806854 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 21:04:13.139433 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806858 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 21:04:13.140492 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806860 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 21:04:13.140492 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806863 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 21:04:13.140492 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806866 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 21:04:13.140492 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806868 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 21:04:13.140492 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806871 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 21:04:13.140492 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806873 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 21:04:13.140492 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806876 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 21:04:13.140492 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806878 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 21:04:13.140492 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806881 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 21:04:13.140492 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806883 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 21:04:13.140492 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806887 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 21:04:13.140492 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806892 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 21:04:13.140492 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806895 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 21:04:13.140492 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806899 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 21:04:13.140492 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806903 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 21:04:13.140492 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806906 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 21:04:13.140492 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806909 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 21:04:13.140492 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806912 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 21:04:13.140492 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806914 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 21:04:13.141519 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806917 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 21:04:13.141519 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806920 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 21:04:13.141519 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806923 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 21:04:13.141519 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806925 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 21:04:13.141519 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806929 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 21:04:13.141519 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806932 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 21:04:13.141519 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806935 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 21:04:13.141519 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806937 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 21:04:13.141519 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806940 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 21:04:13.141519 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806942 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 21:04:13.141519 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806945 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 21:04:13.141519 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806948 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 21:04:13.141519 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806950 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 21:04:13.141519 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806953 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 21:04:13.141519 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806956 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 21:04:13.141519 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806958 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 21:04:13.141519 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806961 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 21:04:13.141519 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806963 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 21:04:13.141519 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806966 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 21:04:13.141519 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806968 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 21:04:13.142534 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806971 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 21:04:13.142534 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806973 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 06 21:04:13.142534 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806976 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 21:04:13.142534 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806978 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 21:04:13.142534 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806982 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 21:04:13.142534 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806984 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 21:04:13.142534 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806987 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 21:04:13.142534 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806989 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 21:04:13.142534 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806992 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 21:04:13.142534 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806994 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 21:04:13.142534 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806997 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 21:04:13.142534 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.806999 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 21:04:13.142534 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.807002 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 21:04:13.142534 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.807005 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 21:04:13.142534 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.807007 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 21:04:13.142534 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.807010 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 21:04:13.142534 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.807014 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 21:04:13.142534 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.807016 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 21:04:13.142534 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.807019 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 21:04:13.142534 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.807021 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 21:04:13.144912 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.807031 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 21:04:13.144912 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.807034 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 21:04:13.144912 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.807037 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 21:04:13.144912 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.807040 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 21:04:13.144912 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.807042 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 21:04:13.144912 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.807045 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 21:04:13.144912 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.807048 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 21:04:13.144912 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.807051 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 21:04:13.144912 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.807055 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 21:04:13.144912 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.807058 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 21:04:13.144912 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.807061 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 21:04:13.144912 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.807064 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 21:04:13.144912 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.807067 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 21:04:13.144912 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.807069 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 21:04:13.144912 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.807072 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 21:04:13.144912 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.807075 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 21:04:13.144912 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.807079 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 21:04:13.144912 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.807082 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 21:04:13.145928 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.807855 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 21:04:13.145928 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.818241 2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 21:04:13.145928 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.818259 2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 21:04:13.145928 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.818282 2563 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 21:04:13.145928 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.818287 2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 21:04:13.145928 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818347 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 21:04:13.145928 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818352 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 21:04:13.145928 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818356 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 21:04:13.145928 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818359 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 21:04:13.145928 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818363 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 21:04:13.145928 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818367 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 21:04:13.145928 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818370 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 21:04:13.145928 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818372 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 21:04:13.145928 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818376 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 21:04:13.148713 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818380 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 21:04:13.148713 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818384 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 21:04:13.148713 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818388 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 21:04:13.148713 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818391 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 21:04:13.148713 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818395 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 21:04:13.148713 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818398 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 21:04:13.148713 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818401 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 21:04:13.148713 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818404 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 21:04:13.148713 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818408 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 21:04:13.148713 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818411 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 21:04:13.148713 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818414 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 21:04:13.148713 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818418 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 21:04:13.148713 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818421 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 21:04:13.148713 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818424 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 21:04:13.148713 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818428 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 21:04:13.148713 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818431 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 21:04:13.148713 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818434 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 21:04:13.148713 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818437 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 21:04:13.148713 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818440 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 21:04:13.149717 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818443 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 21:04:13.149717 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818446 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 21:04:13.149717 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818449 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 21:04:13.149717 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818452 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 21:04:13.149717 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818454 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 21:04:13.149717 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818457 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 21:04:13.149717 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818479 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 21:04:13.149717 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818482 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 21:04:13.149717 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818485 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 21:04:13.149717 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818488 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 21:04:13.149717 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818491 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 21:04:13.149717 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818493 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 21:04:13.149717 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818496 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 21:04:13.149717 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818499 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 21:04:13.149717 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818501 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 21:04:13.149717 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818504 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 21:04:13.149717 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818506 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 21:04:13.149717 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818509 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 21:04:13.149717 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818511 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 21:04:13.149717 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818514 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 21:04:13.151677 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818516 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 21:04:13.151677 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818519 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 21:04:13.151677 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818521 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 21:04:13.151677 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818524 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 21:04:13.151677 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818530 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 21:04:13.151677 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818533 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 21:04:13.151677 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818535 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 21:04:13.151677 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818538 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 21:04:13.151677 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818540 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 21:04:13.151677 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818544 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 21:04:13.151677 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818546 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 21:04:13.151677 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818549 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 21:04:13.151677 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818552 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 21:04:13.151677 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818554 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 21:04:13.151677 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818557 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 21:04:13.151677 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818560 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 21:04:13.151677 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818562 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 21:04:13.151677 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818566 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 21:04:13.151677 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818568 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 06 21:04:13.151677 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818571 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 21:04:13.152682 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818573 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 21:04:13.152682 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818576 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 21:04:13.152682 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818579 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 21:04:13.152682 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818581 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 21:04:13.152682 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818583 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 21:04:13.152682 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818586 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 21:04:13.152682 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818589 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 21:04:13.152682 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818591 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 21:04:13.152682 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818594 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 21:04:13.152682 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818596 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 21:04:13.152682 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818599 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 21:04:13.152682 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818602 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 21:04:13.152682 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818605 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 21:04:13.152682 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818609 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 21:04:13.152682 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818612 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 21:04:13.152682 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818616 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 21:04:13.152682 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818620 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 21:04:13.152682 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818622 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 21:04:13.152682 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818625 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 21:04:13.152682 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818627 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 21:04:13.153679 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818630 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 21:04:13.153679 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818632 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 21:04:13.153679 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818635 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 21:04:13.153679 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818638 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 21:04:13.153679 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818640 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 21:04:13.153679 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818643 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 21:04:13.153679 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818645 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 21:04:13.153679 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818649 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 21:04:13.153679 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818652 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 21:04:13.153679 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818654 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 21:04:13.153679 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818657 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 21:04:13.153679 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.818662 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 21:04:13.153679 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818806 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 21:04:13.153679 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818812 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 21:04:13.153679 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818815 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 21:04:13.154683 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818818 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 21:04:13.154683 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818821 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 21:04:13.154683 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818823 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 21:04:13.154683 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818826 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 21:04:13.154683 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818829 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 21:04:13.154683 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818831 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 21:04:13.154683 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818834 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 21:04:13.154683 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818837 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 21:04:13.154683 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818839 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 21:04:13.154683 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818843 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 21:04:13.154683 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818845 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 21:04:13.154683 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818848 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 21:04:13.154683 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818850 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 21:04:13.154683 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818853 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 21:04:13.154683 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818858 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 21:04:13.154683 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818861 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 21:04:13.154683 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818863 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 21:04:13.154683 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818866 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 21:04:13.154683 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818868 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 21:04:13.154683 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818871 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 21:04:13.155734 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818874 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 21:04:13.155734 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818876 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 21:04:13.155734 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818879 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 21:04:13.155734 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818881 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 21:04:13.155734 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818885 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 21:04:13.155734 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818888 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 21:04:13.155734 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818890 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 21:04:13.155734 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818893 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 21:04:13.155734 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818895 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 21:04:13.155734 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818898 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 21:04:13.155734 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818901 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 21:04:13.155734 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818903 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 21:04:13.155734 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818905 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 21:04:13.155734 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818908 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 21:04:13.155734 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818910 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 21:04:13.155734 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818913 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 21:04:13.155734 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818916 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 21:04:13.155734 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818919 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 21:04:13.155734 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818921 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 21:04:13.155734 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818924 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 21:04:13.158079 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818926 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 21:04:13.158079 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818929 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 21:04:13.158079 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818932 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 21:04:13.158079 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818935 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 21:04:13.158079 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818937 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 21:04:13.158079 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818939 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 21:04:13.158079 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818943 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 21:04:13.158079 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818946 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 21:04:13.158079 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818948 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 21:04:13.158079 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818951 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 21:04:13.158079 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818953 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 21:04:13.158079 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818956 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 21:04:13.158079 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818958 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 21:04:13.158079 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818962 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 21:04:13.158079 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818967 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 21:04:13.158079 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818972 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 21:04:13.158079 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818976 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 21:04:13.158079 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818978 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 21:04:13.158079 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818982 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 21:04:13.159107 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818984 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 21:04:13.159107 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818987 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 21:04:13.159107 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818990 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 21:04:13.159107 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818992 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 21:04:13.159107 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818995 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 06 21:04:13.159107 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.818997 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 21:04:13.159107 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.819000 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 21:04:13.159107 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.819002 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 21:04:13.159107 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.819005 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 21:04:13.159107 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.819009 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 21:04:13.159107 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.819012 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 21:04:13.159107 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.819015 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 21:04:13.159107 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.819018 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 21:04:13.159107 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.819020 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 21:04:13.159107 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.819031 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 21:04:13.159107 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.819034 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 21:04:13.159107 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.819038 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 21:04:13.159107 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.819040 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 21:04:13.159107 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.819043 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 21:04:13.160149 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.819047 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 21:04:13.160149 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.819050 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 21:04:13.160149 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.819052 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 21:04:13.160149 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.819055 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 21:04:13.160149 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.819058 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 21:04:13.160149 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.819060 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 21:04:13.160149 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.819063 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 21:04:13.160149 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.819065 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 21:04:13.160149 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.819068 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 21:04:13.160149 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.819071 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 21:04:13.160149 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.819074 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 21:04:13.160149 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.819077 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 21:04:13.160149 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.819079 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 21:04:13.160149 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.819082 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 21:04:13.160149 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.819084 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 21:04:13.160149 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.819087 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 21:04:13.160149 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.819090 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 21:04:13.160149 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:12.819092 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 21:04:13.161133 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.819097 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 21:04:13.161133 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.819219 2563 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 21:04:13.161133 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.822516 2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 21:04:13.161133 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.824228 2563 server.go:1019] "Starting client certificate rotation" Jul 06 21:04:13.161133 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.824324 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 21:04:13.161133 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.824358 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 21:04:13.161133 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.827075 2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 21:04:13.161133 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.828281 2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 21:04:13.161133 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.836755 2563 log.go:25] "Validated CRI v1 runtime API" Jul 06 21:04:13.161133 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.839614 2563 log.go:25] "Validated CRI v1 image API" Jul 06 21:04:13.161133 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.840417 2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 21:04:13.161133 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.846551 2563 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8fafae29-359c-4523-b30c-def8312a4fbc:/dev/nvme0n1p4 ec63f61d-51b1-4241-a9c7-b5fe9d683ba2:/dev/nvme0n1p3] Jul 06 21:04:13.163036 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.846579 2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 21:04:13.163036 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.856800 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 21:04:13.261787 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.860102 2563 manager.go:216] Machine: {Timestamp:2026-07-06 21:04:12.859328817 +0000 UTC m=+0.379416717 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101270 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b55591bb9ae2793e838c452234a59 SystemUUID:ec2b5559-1bb9-ae27-93e8-38c452234a59 BootID:15c0bd81-f685-48e7-afad-42bb8a878b5f Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:05:65:1a:bc:df Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:05:65:1a:bc:df Speed:0 Mtu:9001} {Name:ovs-system MacAddress:72:8e:5c:1c:b3:95 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 21:04:13.261787 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.860234 2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 21:04:13.261787 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.860329 2563 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 21:04:13.261787 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.864654 2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 21:04:13.261787 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.864683 2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-182.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 21:04:13.261787 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.865527 2563 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 21:04:13.261787 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.865535 2563 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 21:04:13.261787 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.865543 2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 21:04:13.261787 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.866478 2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 21:04:13.261787 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.868369 2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 21:04:13.261787 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.872287 2563 state_mem.go:36] "Initialized new in-memory state store" Jul 06 21:04:13.261787 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.872400 2563 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 21:04:13.261787 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.872428 2563 kubelet.go:486] "Attempting to sync node with API server" Jul 06 21:04:13.261787 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.872436 2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 21:04:13.261787 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.872450 2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 21:04:13.261787 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.872475 2563 kubelet.go:398] "Adding apiserver pod source" Jul 06 21:04:13.261787 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.872484 2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 21:04:13.261787 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.872822 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 21:04:13.263112 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.872836 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 21:04:13.263112 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.876681 2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 21:04:13.263112 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.879227 2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 21:04:13.263112 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.879255 2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 21:04:13.263112 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.880740 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 21:04:13.263112 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.880754 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 21:04:13.263112 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.880760 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 21:04:13.263112 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.880766 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 21:04:13.263112 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.880775 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 21:04:13.263112 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.880783 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 21:04:13.263112 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.880796 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 21:04:13.263112 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.880801 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 21:04:13.263112 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.880808 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 21:04:13.263112 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.880814 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 21:04:13.263112 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.880822 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 21:04:13.263112 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.880828 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 21:04:13.263112 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.882646 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 21:04:13.263112 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.882657 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 21:04:13.263112 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:12.884166 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 21:04:13.263112 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:12.884169 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-182.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 06 21:04:13.263112 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.887068 2563 server.go:1268] "Started kubelet" Jul 06 21:04:13.263112 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.887081 2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-182.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 06 21:04:13.263112 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.887779 2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 21:04:13.263112 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.887837 2563 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 21:04:13.263112 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.888209 2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 21:04:13.263112 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.889344 2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 21:04:13.263112 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.890907 2563 server.go:310] "Adding debug handlers to kubelet server" Jul 06 21:04:13.263112 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:12.895266 2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 21:04:13.263112 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.899364 2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 21:04:13.263112 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.899366 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 21:04:13.263112 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:12.899446 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-182.ec2.internal\" not found" Jul 06 21:04:13.263112 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.900141 2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 21:04:13.263112 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.900147 2563 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 21:04:13.263112 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.900164 2563 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 21:04:13.263112 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.900268 2563 reconstruct.go:97] "Volume reconstruction finished" Jul 06 21:04:13.263112 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.900279 2563 reconciler.go:29] "Reconciler: start to sync state" Jul 06 21:04:13.263112 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.902654 2563 factory.go:55] Registering systemd factory Jul 06 21:04:13.263112 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.902671 2563 factory.go:223] Registration of the systemd container factory successfully Jul 06 21:04:13.263112 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:12.902681 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 06 21:04:13.263112 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.902927 2563 factory.go:153] Registering CRI-O factory Jul 06 21:04:13.263112 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.902940 2563 factory.go:223] Registration of the crio container factory successfully Jul 06 21:04:13.263112 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.902982 2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 21:04:13.263112 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.903009 2563 factory.go:103] Registering Raw factory Jul 06 21:04:13.263112 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.903039 2563 manager.go:1196] Started watching for new ooms in manager Jul 06 21:04:13.263112 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.903426 2563 manager.go:349] Starting recovery of all containers Jul 06 21:04:13.263112 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.903539 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-d28fm" Jul 06 21:04:13.265952 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.908588 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 21:04:13.265952 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.910869 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-d28fm" Jul 06 21:04:13.265952 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:12.914124 2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-182.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 06 21:04:13.265952 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:12.913406 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-182.ec2.internal.18bfcf4061c32c50 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-182.ec2.internal,UID:ip-10-0-131-182.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-182.ec2.internal,},FirstTimestamp:2026-07-06 21:04:12.887043152 +0000 UTC m=+0.407131054,LastTimestamp:2026-07-06 21:04:12.887043152 +0000 UTC m=+0.407131054,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-182.ec2.internal,}" Jul 06 21:04:13.265952 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.917431 2563 manager.go:354] Recovery completed Jul 06 21:04:13.265952 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.923499 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 21:04:13.265952 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.925404 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-182.ec2.internal" event="NodeHasSufficientMemory" Jul 06 21:04:13.265952 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.925435 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-182.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 21:04:13.265952 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.925447 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-182.ec2.internal" event="NodeHasSufficientPID" Jul 06 21:04:13.265952 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.926003 2563 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 21:04:13.265952 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.926012 2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 21:04:13.265952 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.926027 2563 state_mem.go:36] "Initialized new in-memory state store" Jul 06 21:04:13.265952 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.926032 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 21:04:13.265952 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.926754 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-182.ec2.internal" event="NodeHasSufficientMemory" Jul 06 21:04:13.265952 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.926779 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-182.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 21:04:13.265952 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.926795 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-182.ec2.internal" event="NodeHasSufficientPID" Jul 06 21:04:13.265952 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.927095 2563 policy_none.go:49] "None policy: Start" Jul 06 21:04:13.265952 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.927107 2563 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 21:04:13.265952 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.927120 2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 21:04:13.265952 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.928145 2563 policy_none.go:47] "Start" Jul 06 21:04:13.265952 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.974139 2563 manager.go:337] "Starting Device Plugin manager" Jul 06 21:04:13.265952 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:12.974169 2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 21:04:13.265952 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.974179 2563 server.go:87] "Starting device plugin registration server" Jul 06 21:04:13.265952 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.974438 2563 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 21:04:13.265952 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.974591 2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 21:04:13.265952 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.974685 2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 21:04:13.265952 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.974763 2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 21:04:13.265952 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:12.974773 2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 21:04:13.265952 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:12.975240 2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 21:04:13.265952 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:12.975280 2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-182.ec2.internal\" not found" Jul 06 21:04:13.265952 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:13.026648 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 21:04:13.265952 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:13.026686 2563 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 21:04:13.265952 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:13.026706 2563 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 21:04:13.265952 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:13.026736 2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 21:04:13.265952 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:13.029409 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 21:04:13.265952 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:13.075578 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 21:04:13.265952 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:13.076702 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-182.ec2.internal" event="NodeHasSufficientMemory" Jul 06 21:04:13.265952 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:13.076736 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-182.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 21:04:13.265952 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:13.076747 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-182.ec2.internal" event="NodeHasSufficientPID" Jul 06 21:04:13.265952 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:13.076769 2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-182.ec2.internal" Jul 06 21:04:13.265952 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:13.089118 2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-182.ec2.internal" Jul 06 21:04:13.267938 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:13.089139 2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-182.ec2.internal\": node \"ip-10-0-131-182.ec2.internal\" not found" Jul 06 21:04:13.267938 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:13.108797 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-182.ec2.internal\" not found" Jul 06 21:04:13.267938 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:13.126968 2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-182.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-182.ec2.internal"] Jul 06 21:04:13.267938 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:13.127033 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 21:04:13.267938 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:13.129120 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-182.ec2.internal" event="NodeHasSufficientMemory" Jul 06 21:04:13.267938 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:13.129145 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-182.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 21:04:13.267938 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:13.129159 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-182.ec2.internal" event="NodeHasSufficientPID" Jul 06 21:04:13.267938 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:13.130421 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 21:04:13.267938 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:13.130576 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-182.ec2.internal" Jul 06 21:04:13.267938 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:13.130601 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 21:04:13.267938 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:13.131249 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-182.ec2.internal" event="NodeHasSufficientMemory" Jul 06 21:04:13.267938 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:13.131271 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-182.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 21:04:13.267938 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:13.131280 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-182.ec2.internal" event="NodeHasSufficientPID" Jul 06 21:04:13.267938 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:13.131601 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-182.ec2.internal" event="NodeHasSufficientMemory" Jul 06 21:04:13.267938 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:13.131617 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-182.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 21:04:13.267938 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:13.131626 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-182.ec2.internal" event="NodeHasSufficientPID" Jul 06 21:04:13.267938 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:13.132389 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-182.ec2.internal" Jul 06 21:04:13.267938 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:13.132414 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 21:04:13.267938 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:13.133064 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-182.ec2.internal" event="NodeHasSufficientMemory" Jul 06 21:04:13.267938 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:13.133081 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-182.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 21:04:13.267938 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:13.133090 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-182.ec2.internal" event="NodeHasSufficientPID" Jul 06 21:04:15.100752 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:15.100705 2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 21:04:15.101253 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:15.100665 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-182.ec2.internal\" not found" Jul 06 21:04:15.101253 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:15.100701 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 20:59:13 +0000 UTC" deadline="2027-12-01 23:42:17.096818198 +0000 UTC" Jul 06 21:04:15.101253 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:15.100795 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12314h38m1.996030125s" Jul 06 21:04:15.101253 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:15.100870 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection force closed via ClientConn.Close\") has prevented the request from succeeding" Jul 06 21:04:15.109993 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:15.109973 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-182.ec2.internal\" not found" node="ip-10-0-131-182.ec2.internal" Jul 06 21:04:15.112558 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:15.112541 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 21:04:15.116716 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:15.116701 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-182.ec2.internal\" not found" node="ip-10-0-131-182.ec2.internal" Jul 06 21:04:15.200899 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:15.200815 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-182.ec2.internal\" not found" Jul 06 21:04:15.200899 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:15.200827 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c7d7585c17bb1cc23159e5018e86b590-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-182.ec2.internal\" (UID: \"c7d7585c17bb1cc23159e5018e86b590\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-182.ec2.internal" Jul 06 21:04:15.200899 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:15.200866 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c7d7585c17bb1cc23159e5018e86b590-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-182.ec2.internal\" (UID: \"c7d7585c17bb1cc23159e5018e86b590\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-182.ec2.internal" Jul 06 21:04:15.200899 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:15.200891 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0d48b88b816a78be0b1d9723b38c9f11-config\") pod \"kube-apiserver-proxy-ip-10-0-131-182.ec2.internal\" (UID: \"0d48b88b816a78be0b1d9723b38c9f11\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-182.ec2.internal" Jul 06 21:04:15.277759 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:15.277735 2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 21:04:15.301611 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:15.301589 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-182.ec2.internal" Jul 06 21:04:15.301691 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:15.301626 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c7d7585c17bb1cc23159e5018e86b590-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-182.ec2.internal\" (UID: \"c7d7585c17bb1cc23159e5018e86b590\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-182.ec2.internal" Jul 06 21:04:15.301779 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:15.301591 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c7d7585c17bb1cc23159e5018e86b590-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-182.ec2.internal\" (UID: \"c7d7585c17bb1cc23159e5018e86b590\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-182.ec2.internal" Jul 06 21:04:15.301838 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:15.301809 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c7d7585c17bb1cc23159e5018e86b590-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-182.ec2.internal\" (UID: \"c7d7585c17bb1cc23159e5018e86b590\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-182.ec2.internal" Jul 06 21:04:15.301838 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:15.301827 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0d48b88b816a78be0b1d9723b38c9f11-config\") pod \"kube-apiserver-proxy-ip-10-0-131-182.ec2.internal\" (UID: \"0d48b88b816a78be0b1d9723b38c9f11\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-182.ec2.internal" Jul 06 21:04:15.301925 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:15.301852 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0d48b88b816a78be0b1d9723b38c9f11-config\") pod \"kube-apiserver-proxy-ip-10-0-131-182.ec2.internal\" (UID: \"0d48b88b816a78be0b1d9723b38c9f11\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-182.ec2.internal" Jul 06 21:04:15.301925 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:15.301876 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c7d7585c17bb1cc23159e5018e86b590-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-182.ec2.internal\" (UID: \"c7d7585c17bb1cc23159e5018e86b590\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-182.ec2.internal" Jul 06 21:04:15.311151 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:15.311133 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 21:04:15.312506 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:15.312495 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-182.ec2.internal" Jul 06 21:04:15.323710 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:15.323694 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 21:04:15.413205 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:15.413181 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-182.ec2.internal" Jul 06 21:04:15.419979 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:15.419962 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-182.ec2.internal" Jul 06 21:04:16.060570 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:16.060527 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d48b88b816a78be0b1d9723b38c9f11.slice/crio-d30b5ab3a8cbd4288677da208b5ba789d0499e02f7d6cd7a9418d12ebc2986eb WatchSource:0}: Error finding container d30b5ab3a8cbd4288677da208b5ba789d0499e02f7d6cd7a9418d12ebc2986eb: Status 404 returned error can't find the container with id d30b5ab3a8cbd4288677da208b5ba789d0499e02f7d6cd7a9418d12ebc2986eb Jul 06 21:04:16.066449 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:16.066418 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7d7585c17bb1cc23159e5018e86b590.slice/crio-2c6d3bdc96b0966d191089ef1c8af74cc0ff317122058501507340c06fdc84e5 WatchSource:0}: Error finding container 2c6d3bdc96b0966d191089ef1c8af74cc0ff317122058501507340c06fdc84e5: Status 404 returned error can't find the container with id 2c6d3bdc96b0966d191089ef1c8af74cc0ff317122058501507340c06fdc84e5 Jul 06 21:04:16.067290 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.067270 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 21:04:16.101121 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.101091 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 21:04:16.101121 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.101103 2563 apiserver.go:52] "Watching apiserver" Jul 06 21:04:16.103568 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.103526 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-182.ec2.internal" event={"ID":"c7d7585c17bb1cc23159e5018e86b590","Type":"ContainerStarted","Data":"2c6d3bdc96b0966d191089ef1c8af74cc0ff317122058501507340c06fdc84e5"} Jul 06 21:04:16.104594 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.104571 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-182.ec2.internal" event={"ID":"0d48b88b816a78be0b1d9723b38c9f11","Type":"ContainerStarted","Data":"d30b5ab3a8cbd4288677da208b5ba789d0499e02f7d6cd7a9418d12ebc2986eb"} Jul 06 21:04:16.109867 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.109848 2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 21:04:16.112956 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.112938 2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 21:04:16.113295 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.113276 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-182.ec2.internal","openshift-multus/multus-additional-cni-plugins-p2h5x","openshift-ovn-kubernetes/ovnkube-node-nsmng","kube-system/global-pull-secret-syncer-vhsmf","openshift-cluster-node-tuning-operator/tuned-lvxjl","openshift-image-registry/node-ca-28sv5","openshift-multus/multus-24957","openshift-multus/network-metrics-daemon-c795j","openshift-network-diagnostics/network-check-target-lvgtq","openshift-network-operator/iptables-alerter-hnqfz","kube-system/konnectivity-agent-x7g5w","kube-system/kube-apiserver-proxy-ip-10-0-131-182.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xz26","openshift-dns/node-resolver-zhhvw"] Jul 06 21:04:16.114436 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.114418 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 21:04:16.115386 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.115364 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-24957" Jul 06 21:04:16.116726 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.116711 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xz26" Jul 06 21:04:16.117704 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.117683 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 21:04:16.117793 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.117743 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 21:04:16.117793 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.117757 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 21:04:16.117904 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.117856 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 21:04:16.117956 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.117939 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-g9k25\"" Jul 06 21:04:16.118019 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.118003 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.118915 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.118879 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 21:04:16.118915 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.118896 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 21:04:16.118915 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.118907 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-tqngb\"" Jul 06 21:04:16.119088 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.118923 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 21:04:16.119375 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.119359 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhsmf" Jul 06 21:04:16.119451 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:16.119425 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhsmf" podUID="a1dc41f0-1699-4e7b-bebc-15f2494d9d23" Jul 06 21:04:16.120628 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.120611 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 21:04:16.121065 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.121046 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lvxjl" Jul 06 21:04:16.121638 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.121616 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 21:04:16.121731 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.121640 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 21:04:16.122166 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.121947 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 21:04:16.122166 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.122040 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 21:04:16.122166 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.122041 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 21:04:16.122166 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.122138 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9lg9s\"" Jul 06 21:04:16.122400 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.122385 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-28sv5" Jul 06 21:04:16.123146 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.123131 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5d6x5\"" Jul 06 21:04:16.123224 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.123155 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 21:04:16.123417 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.123400 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 21:04:16.123953 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.123935 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvgtq" Jul 06 21:04:16.124042 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:16.123999 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvgtq" podUID="f107cce5-b80b-4c37-9d88-e582acb83168" Jul 06 21:04:16.126851 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.125831 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4r7m6\"" Jul 06 21:04:16.126851 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.126069 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 21:04:16.126851 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.126333 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 21:04:16.126851 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.126598 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 21:04:16.127303 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.127279 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zhhvw" Jul 06 21:04:16.129011 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.128992 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-p2h5x" Jul 06 21:04:16.130268 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.130251 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hnqfz" Jul 06 21:04:16.131384 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.131370 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-x7g5w" Jul 06 21:04:16.132586 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.132565 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c795j" Jul 06 21:04:16.132670 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:16.132633 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c795j" podUID="084dc07e-e49b-44e3-95cc-11e11c5037a5" Jul 06 21:04:16.133348 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.133330 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 21:04:16.133446 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.133386 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 21:04:16.133563 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.133530 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qgrsf\"" Jul 06 21:04:16.133775 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.133762 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 21:04:16.134346 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.134328 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6nptb\"" Jul 06 21:04:16.134477 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.134455 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 21:04:16.134477 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.134481 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 21:04:16.134627 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.134484 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bw98c\"" Jul 06 21:04:16.134627 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.134494 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zddmm\"" Jul 06 21:04:16.134627 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.134595 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 21:04:16.134895 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.134873 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 21:04:16.134895 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.134892 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 21:04:16.135036 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.134905 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 21:04:16.144305 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.144289 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mdbnt" Jul 06 21:04:16.151604 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.151588 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mdbnt" Jul 06 21:04:16.156490 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.156471 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 21:04:16.203771 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.203750 2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 21:04:16.203891 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.203854 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67ff5eff-b2cf-45c9-ab38-9650657413b9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.203891 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.203873 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1cfb7af5-011a-4522-96bf-00eaf75fe18e-etc-kubernetes\") pod \"tuned-lvxjl\" (UID: \"1cfb7af5-011a-4522-96bf-00eaf75fe18e\") " pod="openshift-cluster-node-tuning-operator/tuned-lvxjl" Jul 06 21:04:16.203891 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.203887 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1cfb7af5-011a-4522-96bf-00eaf75fe18e-host\") pod \"tuned-lvxjl\" (UID: \"1cfb7af5-011a-4522-96bf-00eaf75fe18e\") " pod="openshift-cluster-node-tuning-operator/tuned-lvxjl" Jul 06 21:04:16.204026 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.203902 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/34abb9cb-886c-4133-b204-c5c02d6dbdf6-hosts-file\") pod \"node-resolver-zhhvw\" (UID: \"34abb9cb-886c-4133-b204-c5c02d6dbdf6\") " pod="openshift-dns/node-resolver-zhhvw" Jul 06 21:04:16.204026 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.203917 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d1f73fe4-61a3-46b0-9221-4c49b9a74186-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8xz26\" (UID: \"d1f73fe4-61a3-46b0-9221-4c49b9a74186\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xz26" Jul 06 21:04:16.204026 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.203954 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f38e9c39-8bb8-44e7-b69c-1da913bec44a-host-run-netns\") pod \"multus-24957\" (UID: \"f38e9c39-8bb8-44e7-b69c-1da913bec44a\") " pod="openshift-multus/multus-24957" Jul 06 21:04:16.204026 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.203985 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dh4h9\" (UniqueName: \"kubernetes.io/projected/1cfb7af5-011a-4522-96bf-00eaf75fe18e-kube-api-access-dh4h9\") pod \"tuned-lvxjl\" (UID: \"1cfb7af5-011a-4522-96bf-00eaf75fe18e\") " pod="openshift-cluster-node-tuning-operator/tuned-lvxjl" Jul 06 21:04:16.204026 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.204012 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2d9510b7-6982-4ead-a75a-e5816ef5b9ab-cni-binary-copy\") pod \"multus-additional-cni-plugins-p2h5x\" (UID: \"2d9510b7-6982-4ead-a75a-e5816ef5b9ab\") " pod="openshift-multus/multus-additional-cni-plugins-p2h5x" Jul 06 21:04:16.204210 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.204027 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d1f73fe4-61a3-46b0-9221-4c49b9a74186-registration-dir\") pod \"aws-ebs-csi-driver-node-8xz26\" (UID: \"d1f73fe4-61a3-46b0-9221-4c49b9a74186\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xz26" Jul 06 21:04:16.204210 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.204050 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f38e9c39-8bb8-44e7-b69c-1da913bec44a-hostroot\") pod \"multus-24957\" (UID: \"f38e9c39-8bb8-44e7-b69c-1da913bec44a\") " pod="openshift-multus/multus-24957" Jul 06 21:04:16.204210 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.204068 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f38e9c39-8bb8-44e7-b69c-1da913bec44a-etc-kubernetes\") pod \"multus-24957\" (UID: \"f38e9c39-8bb8-44e7-b69c-1da913bec44a\") " pod="openshift-multus/multus-24957" Jul 06 21:04:16.204210 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.204086 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/67ff5eff-b2cf-45c9-ab38-9650657413b9-node-log\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.204210 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.204113 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/67ff5eff-b2cf-45c9-ab38-9650657413b9-log-socket\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.204210 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.204136 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/67ff5eff-b2cf-45c9-ab38-9650657413b9-host-cni-netd\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.204210 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.204156 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d1f73fe4-61a3-46b0-9221-4c49b9a74186-socket-dir\") pod \"aws-ebs-csi-driver-node-8xz26\" (UID: \"d1f73fe4-61a3-46b0-9221-4c49b9a74186\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xz26" Jul 06 21:04:16.204210 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.204172 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1dc41f0-1699-4e7b-bebc-15f2494d9d23-original-pull-secret\") pod \"global-pull-secret-syncer-vhsmf\" (UID: \"a1dc41f0-1699-4e7b-bebc-15f2494d9d23\") " pod="kube-system/global-pull-secret-syncer-vhsmf" Jul 06 21:04:16.204210 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.204191 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f38e9c39-8bb8-44e7-b69c-1da913bec44a-cnibin\") pod \"multus-24957\" (UID: \"f38e9c39-8bb8-44e7-b69c-1da913bec44a\") " pod="openshift-multus/multus-24957" Jul 06 21:04:16.204535 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.204221 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/67ff5eff-b2cf-45c9-ab38-9650657413b9-ovnkube-script-lib\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.204535 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.204249 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1cfb7af5-011a-4522-96bf-00eaf75fe18e-etc-sysctl-d\") pod \"tuned-lvxjl\" (UID: \"1cfb7af5-011a-4522-96bf-00eaf75fe18e\") " pod="openshift-cluster-node-tuning-operator/tuned-lvxjl" Jul 06 21:04:16.204535 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.204263 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a7028afb-6989-4fe8-a9a6-1230b13b505e-host\") pod \"node-ca-28sv5\" (UID: \"a7028afb-6989-4fe8-a9a6-1230b13b505e\") " pod="openshift-image-registry/node-ca-28sv5" Jul 06 21:04:16.204535 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.204284 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25k7b\" (UniqueName: \"kubernetes.io/projected/34abb9cb-886c-4133-b204-c5c02d6dbdf6-kube-api-access-25k7b\") pod \"node-resolver-zhhvw\" (UID: \"34abb9cb-886c-4133-b204-c5c02d6dbdf6\") " pod="openshift-dns/node-resolver-zhhvw" Jul 06 21:04:16.204535 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.204301 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2d9510b7-6982-4ead-a75a-e5816ef5b9ab-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p2h5x\" (UID: \"2d9510b7-6982-4ead-a75a-e5816ef5b9ab\") " pod="openshift-multus/multus-additional-cni-plugins-p2h5x" Jul 06 21:04:16.204535 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.204331 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f38e9c39-8bb8-44e7-b69c-1da913bec44a-multus-socket-dir-parent\") pod \"multus-24957\" (UID: \"f38e9c39-8bb8-44e7-b69c-1da913bec44a\") " pod="openshift-multus/multus-24957" Jul 06 21:04:16.204535 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.204348 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc9n6\" (UniqueName: \"kubernetes.io/projected/67ff5eff-b2cf-45c9-ab38-9650657413b9-kube-api-access-xc9n6\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.204535 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.204363 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1cfb7af5-011a-4522-96bf-00eaf75fe18e-etc-sysconfig\") pod \"tuned-lvxjl\" (UID: \"1cfb7af5-011a-4522-96bf-00eaf75fe18e\") " pod="openshift-cluster-node-tuning-operator/tuned-lvxjl" Jul 06 21:04:16.204535 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.204385 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/084dc07e-e49b-44e3-95cc-11e11c5037a5-metrics-certs\") pod \"network-metrics-daemon-c795j\" (UID: \"084dc07e-e49b-44e3-95cc-11e11c5037a5\") " pod="openshift-multus/network-metrics-daemon-c795j" Jul 06 21:04:16.204535 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.204400 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f38e9c39-8bb8-44e7-b69c-1da913bec44a-host-run-multus-certs\") pod \"multus-24957\" (UID: \"f38e9c39-8bb8-44e7-b69c-1da913bec44a\") " pod="openshift-multus/multus-24957" Jul 06 21:04:16.204535 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.204414 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/67ff5eff-b2cf-45c9-ab38-9650657413b9-host-run-netns\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.204535 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.204433 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1cfb7af5-011a-4522-96bf-00eaf75fe18e-etc-modprobe-d\") pod \"tuned-lvxjl\" (UID: \"1cfb7af5-011a-4522-96bf-00eaf75fe18e\") " pod="openshift-cluster-node-tuning-operator/tuned-lvxjl" Jul 06 21:04:16.204535 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.204460 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1cfb7af5-011a-4522-96bf-00eaf75fe18e-etc-sysctl-conf\") pod \"tuned-lvxjl\" (UID: \"1cfb7af5-011a-4522-96bf-00eaf75fe18e\") " pod="openshift-cluster-node-tuning-operator/tuned-lvxjl" Jul 06 21:04:16.204535 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.204475 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1cfb7af5-011a-4522-96bf-00eaf75fe18e-sys\") pod \"tuned-lvxjl\" (UID: \"1cfb7af5-011a-4522-96bf-00eaf75fe18e\") " pod="openshift-cluster-node-tuning-operator/tuned-lvxjl" Jul 06 21:04:16.204535 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.204489 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d9510b7-6982-4ead-a75a-e5816ef5b9ab-system-cni-dir\") pod \"multus-additional-cni-plugins-p2h5x\" (UID: \"2d9510b7-6982-4ead-a75a-e5816ef5b9ab\") " pod="openshift-multus/multus-additional-cni-plugins-p2h5x" Jul 06 21:04:16.204535 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.204515 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67ff5eff-b2cf-45c9-ab38-9650657413b9-host-run-ovn-kubernetes\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.205167 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.204534 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d1f73fe4-61a3-46b0-9221-4c49b9a74186-etc-selinux\") pod \"aws-ebs-csi-driver-node-8xz26\" (UID: \"d1f73fe4-61a3-46b0-9221-4c49b9a74186\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xz26" Jul 06 21:04:16.205167 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.204573 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f38e9c39-8bb8-44e7-b69c-1da913bec44a-host-run-k8s-cni-cncf-io\") pod \"multus-24957\" (UID: \"f38e9c39-8bb8-44e7-b69c-1da913bec44a\") " pod="openshift-multus/multus-24957" Jul 06 21:04:16.205167 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.204590 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1cfb7af5-011a-4522-96bf-00eaf75fe18e-run\") pod \"tuned-lvxjl\" (UID: \"1cfb7af5-011a-4522-96bf-00eaf75fe18e\") " pod="openshift-cluster-node-tuning-operator/tuned-lvxjl" Jul 06 21:04:16.205167 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.204605 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a1dc41f0-1699-4e7b-bebc-15f2494d9d23-dbus\") pod \"global-pull-secret-syncer-vhsmf\" (UID: \"a1dc41f0-1699-4e7b-bebc-15f2494d9d23\") " pod="kube-system/global-pull-secret-syncer-vhsmf" Jul 06 21:04:16.205167 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.204629 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6795ede2-22ae-4bd6-932a-f1b7ff2a54ed-iptables-alerter-script\") pod \"iptables-alerter-hnqfz\" (UID: \"6795ede2-22ae-4bd6-932a-f1b7ff2a54ed\") " pod="openshift-network-operator/iptables-alerter-hnqfz" Jul 06 21:04:16.205167 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.204656 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f38e9c39-8bb8-44e7-b69c-1da913bec44a-cni-binary-copy\") pod \"multus-24957\" (UID: \"f38e9c39-8bb8-44e7-b69c-1da913bec44a\") " pod="openshift-multus/multus-24957" Jul 06 21:04:16.205167 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.204677 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/67ff5eff-b2cf-45c9-ab38-9650657413b9-systemd-units\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.205167 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.204693 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/67ff5eff-b2cf-45c9-ab38-9650657413b9-host-slash\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.205167 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.204735 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2d9510b7-6982-4ead-a75a-e5816ef5b9ab-cnibin\") pod \"multus-additional-cni-plugins-p2h5x\" (UID: \"2d9510b7-6982-4ead-a75a-e5816ef5b9ab\") " pod="openshift-multus/multus-additional-cni-plugins-p2h5x" Jul 06 21:04:16.205167 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.204769 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gknv\" (UniqueName: \"kubernetes.io/projected/084dc07e-e49b-44e3-95cc-11e11c5037a5-kube-api-access-4gknv\") pod \"network-metrics-daemon-c795j\" (UID: \"084dc07e-e49b-44e3-95cc-11e11c5037a5\") " pod="openshift-multus/network-metrics-daemon-c795j" Jul 06 21:04:16.205167 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.204793 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/67ff5eff-b2cf-45c9-ab38-9650657413b9-run-systemd\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.205167 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.204817 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8drhf\" (UniqueName: \"kubernetes.io/projected/f107cce5-b80b-4c37-9d88-e582acb83168-kube-api-access-8drhf\") pod \"network-check-target-lvgtq\" (UID: \"f107cce5-b80b-4c37-9d88-e582acb83168\") " pod="openshift-network-diagnostics/network-check-target-lvgtq" Jul 06 21:04:16.205167 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.204841 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lb6sc\" (UniqueName: \"kubernetes.io/projected/6795ede2-22ae-4bd6-932a-f1b7ff2a54ed-kube-api-access-lb6sc\") pod \"iptables-alerter-hnqfz\" (UID: \"6795ede2-22ae-4bd6-932a-f1b7ff2a54ed\") " pod="openshift-network-operator/iptables-alerter-hnqfz" Jul 06 21:04:16.205167 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.204863 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/67ff5eff-b2cf-45c9-ab38-9650657413b9-run-ovn\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.205167 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.204892 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/67ff5eff-b2cf-45c9-ab38-9650657413b9-host-cni-bin\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.205167 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.204916 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/67ff5eff-b2cf-45c9-ab38-9650657413b9-env-overrides\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.205785 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.204939 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/67ff5eff-b2cf-45c9-ab38-9650657413b9-ovn-node-metrics-cert\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.205785 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.204961 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1cfb7af5-011a-4522-96bf-00eaf75fe18e-etc-tuned\") pod \"tuned-lvxjl\" (UID: \"1cfb7af5-011a-4522-96bf-00eaf75fe18e\") " pod="openshift-cluster-node-tuning-operator/tuned-lvxjl" Jul 06 21:04:16.205785 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.204983 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2d9510b7-6982-4ead-a75a-e5816ef5b9ab-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p2h5x\" (UID: \"2d9510b7-6982-4ead-a75a-e5816ef5b9ab\") " pod="openshift-multus/multus-additional-cni-plugins-p2h5x" Jul 06 21:04:16.205785 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.205027 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f38e9c39-8bb8-44e7-b69c-1da913bec44a-os-release\") pod \"multus-24957\" (UID: \"f38e9c39-8bb8-44e7-b69c-1da913bec44a\") " pod="openshift-multus/multus-24957" Jul 06 21:04:16.205785 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.205053 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67ff5eff-b2cf-45c9-ab38-9650657413b9-var-lib-openvswitch\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.205785 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.205073 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/67ff5eff-b2cf-45c9-ab38-9650657413b9-ovnkube-config\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.205785 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.205093 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1cfb7af5-011a-4522-96bf-00eaf75fe18e-var-lib-kubelet\") pod \"tuned-lvxjl\" (UID: \"1cfb7af5-011a-4522-96bf-00eaf75fe18e\") " pod="openshift-cluster-node-tuning-operator/tuned-lvxjl" Jul 06 21:04:16.205785 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.205109 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a1dc41f0-1699-4e7b-bebc-15f2494d9d23-kubelet-config\") pod \"global-pull-secret-syncer-vhsmf\" (UID: \"a1dc41f0-1699-4e7b-bebc-15f2494d9d23\") " pod="kube-system/global-pull-secret-syncer-vhsmf" Jul 06 21:04:16.205785 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.205122 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a58f0fcd-7bf3-4366-b3b2-622f57f9253b-konnectivity-ca\") pod \"konnectivity-agent-x7g5w\" (UID: \"a58f0fcd-7bf3-4366-b3b2-622f57f9253b\") " pod="kube-system/konnectivity-agent-x7g5w" Jul 06 21:04:16.205785 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.205136 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f38e9c39-8bb8-44e7-b69c-1da913bec44a-multus-cni-dir\") pod \"multus-24957\" (UID: \"f38e9c39-8bb8-44e7-b69c-1da913bec44a\") " pod="openshift-multus/multus-24957" Jul 06 21:04:16.205785 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.205149 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f38e9c39-8bb8-44e7-b69c-1da913bec44a-multus-daemon-config\") pod \"multus-24957\" (UID: \"f38e9c39-8bb8-44e7-b69c-1da913bec44a\") " pod="openshift-multus/multus-24957" Jul 06 21:04:16.205785 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.205166 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d1f73fe4-61a3-46b0-9221-4c49b9a74186-device-dir\") pod \"aws-ebs-csi-driver-node-8xz26\" (UID: \"d1f73fe4-61a3-46b0-9221-4c49b9a74186\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xz26" Jul 06 21:04:16.205785 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.205185 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bn678\" (UniqueName: \"kubernetes.io/projected/f38e9c39-8bb8-44e7-b69c-1da913bec44a-kube-api-access-bn678\") pod \"multus-24957\" (UID: \"f38e9c39-8bb8-44e7-b69c-1da913bec44a\") " pod="openshift-multus/multus-24957" Jul 06 21:04:16.205785 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.205199 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a7028afb-6989-4fe8-a9a6-1230b13b505e-serviceca\") pod \"node-ca-28sv5\" (UID: \"a7028afb-6989-4fe8-a9a6-1230b13b505e\") " pod="openshift-image-registry/node-ca-28sv5" Jul 06 21:04:16.205785 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.205213 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34abb9cb-886c-4133-b204-c5c02d6dbdf6-tmp-dir\") pod \"node-resolver-zhhvw\" (UID: \"34abb9cb-886c-4133-b204-c5c02d6dbdf6\") " pod="openshift-dns/node-resolver-zhhvw" Jul 06 21:04:16.205785 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.205226 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2d9510b7-6982-4ead-a75a-e5816ef5b9ab-os-release\") pod \"multus-additional-cni-plugins-p2h5x\" (UID: \"2d9510b7-6982-4ead-a75a-e5816ef5b9ab\") " pod="openshift-multus/multus-additional-cni-plugins-p2h5x" Jul 06 21:04:16.206220 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.205240 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffjc9\" (UniqueName: \"kubernetes.io/projected/2d9510b7-6982-4ead-a75a-e5816ef5b9ab-kube-api-access-ffjc9\") pod \"multus-additional-cni-plugins-p2h5x\" (UID: \"2d9510b7-6982-4ead-a75a-e5816ef5b9ab\") " pod="openshift-multus/multus-additional-cni-plugins-p2h5x" Jul 06 21:04:16.206220 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.205261 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1cfb7af5-011a-4522-96bf-00eaf75fe18e-etc-systemd\") pod \"tuned-lvxjl\" (UID: \"1cfb7af5-011a-4522-96bf-00eaf75fe18e\") " pod="openshift-cluster-node-tuning-operator/tuned-lvxjl" Jul 06 21:04:16.206220 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.205286 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67ff5eff-b2cf-45c9-ab38-9650657413b9-run-openvswitch\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.206220 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.205328 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6795ede2-22ae-4bd6-932a-f1b7ff2a54ed-host-slash\") pod \"iptables-alerter-hnqfz\" (UID: \"6795ede2-22ae-4bd6-932a-f1b7ff2a54ed\") " pod="openshift-network-operator/iptables-alerter-hnqfz" Jul 06 21:04:16.206220 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.205348 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f38e9c39-8bb8-44e7-b69c-1da913bec44a-system-cni-dir\") pod \"multus-24957\" (UID: \"f38e9c39-8bb8-44e7-b69c-1da913bec44a\") " pod="openshift-multus/multus-24957" Jul 06 21:04:16.206220 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.205369 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f38e9c39-8bb8-44e7-b69c-1da913bec44a-host-var-lib-cni-multus\") pod \"multus-24957\" (UID: \"f38e9c39-8bb8-44e7-b69c-1da913bec44a\") " pod="openshift-multus/multus-24957" Jul 06 21:04:16.206220 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.205386 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f38e9c39-8bb8-44e7-b69c-1da913bec44a-multus-conf-dir\") pod \"multus-24957\" (UID: \"f38e9c39-8bb8-44e7-b69c-1da913bec44a\") " pod="openshift-multus/multus-24957" Jul 06 21:04:16.206220 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.205403 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67ff5eff-b2cf-45c9-ab38-9650657413b9-etc-openvswitch\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.206220 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.205419 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2d9510b7-6982-4ead-a75a-e5816ef5b9ab-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p2h5x\" (UID: \"2d9510b7-6982-4ead-a75a-e5816ef5b9ab\") " pod="openshift-multus/multus-additional-cni-plugins-p2h5x" Jul 06 21:04:16.206220 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.205442 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npbz2\" (UniqueName: \"kubernetes.io/projected/d1f73fe4-61a3-46b0-9221-4c49b9a74186-kube-api-access-npbz2\") pod \"aws-ebs-csi-driver-node-8xz26\" (UID: \"d1f73fe4-61a3-46b0-9221-4c49b9a74186\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xz26" Jul 06 21:04:16.206220 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.205455 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a58f0fcd-7bf3-4366-b3b2-622f57f9253b-agent-certs\") pod \"konnectivity-agent-x7g5w\" (UID: \"a58f0fcd-7bf3-4366-b3b2-622f57f9253b\") " pod="kube-system/konnectivity-agent-x7g5w" Jul 06 21:04:16.206220 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.205470 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f38e9c39-8bb8-44e7-b69c-1da913bec44a-host-var-lib-cni-bin\") pod \"multus-24957\" (UID: \"f38e9c39-8bb8-44e7-b69c-1da913bec44a\") " pod="openshift-multus/multus-24957" Jul 06 21:04:16.206220 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.205484 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f38e9c39-8bb8-44e7-b69c-1da913bec44a-host-var-lib-kubelet\") pod \"multus-24957\" (UID: \"f38e9c39-8bb8-44e7-b69c-1da913bec44a\") " pod="openshift-multus/multus-24957" Jul 06 21:04:16.206220 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.205502 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1cfb7af5-011a-4522-96bf-00eaf75fe18e-lib-modules\") pod \"tuned-lvxjl\" (UID: \"1cfb7af5-011a-4522-96bf-00eaf75fe18e\") " pod="openshift-cluster-node-tuning-operator/tuned-lvxjl" Jul 06 21:04:16.206220 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.205517 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1cfb7af5-011a-4522-96bf-00eaf75fe18e-tmp\") pod \"tuned-lvxjl\" (UID: \"1cfb7af5-011a-4522-96bf-00eaf75fe18e\") " pod="openshift-cluster-node-tuning-operator/tuned-lvxjl" Jul 06 21:04:16.206220 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.205533 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrg6d\" (UniqueName: \"kubernetes.io/projected/a7028afb-6989-4fe8-a9a6-1230b13b505e-kube-api-access-hrg6d\") pod \"node-ca-28sv5\" (UID: \"a7028afb-6989-4fe8-a9a6-1230b13b505e\") " pod="openshift-image-registry/node-ca-28sv5" Jul 06 21:04:16.206691 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.205554 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d1f73fe4-61a3-46b0-9221-4c49b9a74186-sys-fs\") pod \"aws-ebs-csi-driver-node-8xz26\" (UID: \"d1f73fe4-61a3-46b0-9221-4c49b9a74186\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xz26" Jul 06 21:04:16.206691 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.205586 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/67ff5eff-b2cf-45c9-ab38-9650657413b9-host-kubelet\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.306417 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.306330 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f38e9c39-8bb8-44e7-b69c-1da913bec44a-system-cni-dir\") pod \"multus-24957\" (UID: \"f38e9c39-8bb8-44e7-b69c-1da913bec44a\") " pod="openshift-multus/multus-24957" Jul 06 21:04:16.306417 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.306367 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f38e9c39-8bb8-44e7-b69c-1da913bec44a-host-var-lib-cni-multus\") pod \"multus-24957\" (UID: \"f38e9c39-8bb8-44e7-b69c-1da913bec44a\") " pod="openshift-multus/multus-24957" Jul 06 21:04:16.306417 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.306383 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f38e9c39-8bb8-44e7-b69c-1da913bec44a-multus-conf-dir\") pod \"multus-24957\" (UID: \"f38e9c39-8bb8-44e7-b69c-1da913bec44a\") " pod="openshift-multus/multus-24957" Jul 06 21:04:16.306417 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.306417 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67ff5eff-b2cf-45c9-ab38-9650657413b9-etc-openvswitch\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.306719 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.306442 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2d9510b7-6982-4ead-a75a-e5816ef5b9ab-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p2h5x\" (UID: \"2d9510b7-6982-4ead-a75a-e5816ef5b9ab\") " pod="openshift-multus/multus-additional-cni-plugins-p2h5x" Jul 06 21:04:16.306719 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.306464 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f38e9c39-8bb8-44e7-b69c-1da913bec44a-host-var-lib-cni-multus\") pod \"multus-24957\" (UID: \"f38e9c39-8bb8-44e7-b69c-1da913bec44a\") " pod="openshift-multus/multus-24957" Jul 06 21:04:16.306719 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.306495 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f38e9c39-8bb8-44e7-b69c-1da913bec44a-multus-conf-dir\") pod \"multus-24957\" (UID: \"f38e9c39-8bb8-44e7-b69c-1da913bec44a\") " pod="openshift-multus/multus-24957" Jul 06 21:04:16.306719 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.306513 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67ff5eff-b2cf-45c9-ab38-9650657413b9-etc-openvswitch\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.306719 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.306467 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npbz2\" (UniqueName: \"kubernetes.io/projected/d1f73fe4-61a3-46b0-9221-4c49b9a74186-kube-api-access-npbz2\") pod \"aws-ebs-csi-driver-node-8xz26\" (UID: \"d1f73fe4-61a3-46b0-9221-4c49b9a74186\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xz26" Jul 06 21:04:16.306719 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.306547 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a58f0fcd-7bf3-4366-b3b2-622f57f9253b-agent-certs\") pod \"konnectivity-agent-x7g5w\" (UID: \"a58f0fcd-7bf3-4366-b3b2-622f57f9253b\") " pod="kube-system/konnectivity-agent-x7g5w" Jul 06 21:04:16.306719 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.306573 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f38e9c39-8bb8-44e7-b69c-1da913bec44a-host-var-lib-cni-bin\") pod \"multus-24957\" (UID: \"f38e9c39-8bb8-44e7-b69c-1da913bec44a\") " pod="openshift-multus/multus-24957" Jul 06 21:04:16.306719 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.306589 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f38e9c39-8bb8-44e7-b69c-1da913bec44a-host-var-lib-kubelet\") pod \"multus-24957\" (UID: \"f38e9c39-8bb8-44e7-b69c-1da913bec44a\") " pod="openshift-multus/multus-24957" Jul 06 21:04:16.306719 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.306466 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f38e9c39-8bb8-44e7-b69c-1da913bec44a-system-cni-dir\") pod \"multus-24957\" (UID: \"f38e9c39-8bb8-44e7-b69c-1da913bec44a\") " pod="openshift-multus/multus-24957" Jul 06 21:04:16.306719 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.306604 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1cfb7af5-011a-4522-96bf-00eaf75fe18e-lib-modules\") pod \"tuned-lvxjl\" (UID: \"1cfb7af5-011a-4522-96bf-00eaf75fe18e\") " pod="openshift-cluster-node-tuning-operator/tuned-lvxjl" Jul 06 21:04:16.306719 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.306627 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1cfb7af5-011a-4522-96bf-00eaf75fe18e-tmp\") pod \"tuned-lvxjl\" (UID: \"1cfb7af5-011a-4522-96bf-00eaf75fe18e\") " pod="openshift-cluster-node-tuning-operator/tuned-lvxjl" Jul 06 21:04:16.306719 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.306639 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f38e9c39-8bb8-44e7-b69c-1da913bec44a-host-var-lib-cni-bin\") pod \"multus-24957\" (UID: \"f38e9c39-8bb8-44e7-b69c-1da913bec44a\") " pod="openshift-multus/multus-24957" Jul 06 21:04:16.306719 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.306651 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrg6d\" (UniqueName: \"kubernetes.io/projected/a7028afb-6989-4fe8-a9a6-1230b13b505e-kube-api-access-hrg6d\") pod \"node-ca-28sv5\" (UID: \"a7028afb-6989-4fe8-a9a6-1230b13b505e\") " pod="openshift-image-registry/node-ca-28sv5" Jul 06 21:04:16.306719 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.306674 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d1f73fe4-61a3-46b0-9221-4c49b9a74186-sys-fs\") pod \"aws-ebs-csi-driver-node-8xz26\" (UID: \"d1f73fe4-61a3-46b0-9221-4c49b9a74186\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xz26" Jul 06 21:04:16.306719 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.306699 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/67ff5eff-b2cf-45c9-ab38-9650657413b9-host-kubelet\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.306719 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.306668 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f38e9c39-8bb8-44e7-b69c-1da913bec44a-host-var-lib-kubelet\") pod \"multus-24957\" (UID: \"f38e9c39-8bb8-44e7-b69c-1da913bec44a\") " pod="openshift-multus/multus-24957" Jul 06 21:04:16.307497 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.306725 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67ff5eff-b2cf-45c9-ab38-9650657413b9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.307497 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.306774 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1cfb7af5-011a-4522-96bf-00eaf75fe18e-etc-kubernetes\") pod \"tuned-lvxjl\" (UID: \"1cfb7af5-011a-4522-96bf-00eaf75fe18e\") " pod="openshift-cluster-node-tuning-operator/tuned-lvxjl" Jul 06 21:04:16.307497 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.306781 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d1f73fe4-61a3-46b0-9221-4c49b9a74186-sys-fs\") pod \"aws-ebs-csi-driver-node-8xz26\" (UID: \"d1f73fe4-61a3-46b0-9221-4c49b9a74186\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xz26" Jul 06 21:04:16.307497 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.306792 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1cfb7af5-011a-4522-96bf-00eaf75fe18e-lib-modules\") pod \"tuned-lvxjl\" (UID: \"1cfb7af5-011a-4522-96bf-00eaf75fe18e\") " pod="openshift-cluster-node-tuning-operator/tuned-lvxjl" Jul 06 21:04:16.307497 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.306796 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1cfb7af5-011a-4522-96bf-00eaf75fe18e-host\") pod \"tuned-lvxjl\" (UID: \"1cfb7af5-011a-4522-96bf-00eaf75fe18e\") " pod="openshift-cluster-node-tuning-operator/tuned-lvxjl" Jul 06 21:04:16.307497 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.306832 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67ff5eff-b2cf-45c9-ab38-9650657413b9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.307497 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.306848 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1cfb7af5-011a-4522-96bf-00eaf75fe18e-etc-kubernetes\") pod \"tuned-lvxjl\" (UID: \"1cfb7af5-011a-4522-96bf-00eaf75fe18e\") " pod="openshift-cluster-node-tuning-operator/tuned-lvxjl" Jul 06 21:04:16.307497 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.306860 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/34abb9cb-886c-4133-b204-c5c02d6dbdf6-hosts-file\") pod \"node-resolver-zhhvw\" (UID: \"34abb9cb-886c-4133-b204-c5c02d6dbdf6\") " pod="openshift-dns/node-resolver-zhhvw" Jul 06 21:04:16.307497 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.306870 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/67ff5eff-b2cf-45c9-ab38-9650657413b9-host-kubelet\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.307497 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.306878 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1cfb7af5-011a-4522-96bf-00eaf75fe18e-host\") pod \"tuned-lvxjl\" (UID: \"1cfb7af5-011a-4522-96bf-00eaf75fe18e\") " pod="openshift-cluster-node-tuning-operator/tuned-lvxjl" Jul 06 21:04:16.307497 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.306903 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d1f73fe4-61a3-46b0-9221-4c49b9a74186-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8xz26\" (UID: \"d1f73fe4-61a3-46b0-9221-4c49b9a74186\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xz26" Jul 06 21:04:16.307497 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.306921 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/34abb9cb-886c-4133-b204-c5c02d6dbdf6-hosts-file\") pod \"node-resolver-zhhvw\" (UID: \"34abb9cb-886c-4133-b204-c5c02d6dbdf6\") " pod="openshift-dns/node-resolver-zhhvw" Jul 06 21:04:16.307497 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.306930 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f38e9c39-8bb8-44e7-b69c-1da913bec44a-host-run-netns\") pod \"multus-24957\" (UID: \"f38e9c39-8bb8-44e7-b69c-1da913bec44a\") " pod="openshift-multus/multus-24957" Jul 06 21:04:16.307497 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.306914 2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 21:04:16.307497 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.306968 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d1f73fe4-61a3-46b0-9221-4c49b9a74186-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8xz26\" (UID: \"d1f73fe4-61a3-46b0-9221-4c49b9a74186\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xz26" Jul 06 21:04:16.307497 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.306980 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f38e9c39-8bb8-44e7-b69c-1da913bec44a-host-run-netns\") pod \"multus-24957\" (UID: \"f38e9c39-8bb8-44e7-b69c-1da913bec44a\") " pod="openshift-multus/multus-24957" Jul 06 21:04:16.307497 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.307016 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh4h9\" (UniqueName: \"kubernetes.io/projected/1cfb7af5-011a-4522-96bf-00eaf75fe18e-kube-api-access-dh4h9\") pod \"tuned-lvxjl\" (UID: \"1cfb7af5-011a-4522-96bf-00eaf75fe18e\") " pod="openshift-cluster-node-tuning-operator/tuned-lvxjl" Jul 06 21:04:16.307497 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.307038 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2d9510b7-6982-4ead-a75a-e5816ef5b9ab-cni-binary-copy\") pod \"multus-additional-cni-plugins-p2h5x\" (UID: \"2d9510b7-6982-4ead-a75a-e5816ef5b9ab\") " pod="openshift-multus/multus-additional-cni-plugins-p2h5x" Jul 06 21:04:16.308287 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.307053 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d1f73fe4-61a3-46b0-9221-4c49b9a74186-registration-dir\") pod \"aws-ebs-csi-driver-node-8xz26\" (UID: \"d1f73fe4-61a3-46b0-9221-4c49b9a74186\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xz26" Jul 06 21:04:16.308287 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.307069 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f38e9c39-8bb8-44e7-b69c-1da913bec44a-hostroot\") pod \"multus-24957\" (UID: \"f38e9c39-8bb8-44e7-b69c-1da913bec44a\") " pod="openshift-multus/multus-24957" Jul 06 21:04:16.308287 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.307091 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f38e9c39-8bb8-44e7-b69c-1da913bec44a-etc-kubernetes\") pod \"multus-24957\" (UID: \"f38e9c39-8bb8-44e7-b69c-1da913bec44a\") " pod="openshift-multus/multus-24957" Jul 06 21:04:16.308287 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.307153 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d1f73fe4-61a3-46b0-9221-4c49b9a74186-registration-dir\") pod \"aws-ebs-csi-driver-node-8xz26\" (UID: \"d1f73fe4-61a3-46b0-9221-4c49b9a74186\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xz26" Jul 06 21:04:16.308287 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.307176 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2d9510b7-6982-4ead-a75a-e5816ef5b9ab-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p2h5x\" (UID: \"2d9510b7-6982-4ead-a75a-e5816ef5b9ab\") " pod="openshift-multus/multus-additional-cni-plugins-p2h5x" Jul 06 21:04:16.308287 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.307208 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/67ff5eff-b2cf-45c9-ab38-9650657413b9-node-log\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.308287 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.307231 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/67ff5eff-b2cf-45c9-ab38-9650657413b9-node-log\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.308287 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.307257 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/67ff5eff-b2cf-45c9-ab38-9650657413b9-log-socket\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.308287 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.307265 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f38e9c39-8bb8-44e7-b69c-1da913bec44a-hostroot\") pod \"multus-24957\" (UID: \"f38e9c39-8bb8-44e7-b69c-1da913bec44a\") " pod="openshift-multus/multus-24957" Jul 06 21:04:16.308287 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.307290 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f38e9c39-8bb8-44e7-b69c-1da913bec44a-etc-kubernetes\") pod \"multus-24957\" (UID: \"f38e9c39-8bb8-44e7-b69c-1da913bec44a\") " pod="openshift-multus/multus-24957" Jul 06 21:04:16.308287 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.307288 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/67ff5eff-b2cf-45c9-ab38-9650657413b9-host-cni-netd\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.308287 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.307334 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/67ff5eff-b2cf-45c9-ab38-9650657413b9-log-socket\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.308287 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.307341 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d1f73fe4-61a3-46b0-9221-4c49b9a74186-socket-dir\") pod \"aws-ebs-csi-driver-node-8xz26\" (UID: \"d1f73fe4-61a3-46b0-9221-4c49b9a74186\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xz26" Jul 06 21:04:16.308287 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.307380 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/67ff5eff-b2cf-45c9-ab38-9650657413b9-host-cni-netd\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.308287 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.307385 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1dc41f0-1699-4e7b-bebc-15f2494d9d23-original-pull-secret\") pod \"global-pull-secret-syncer-vhsmf\" (UID: \"a1dc41f0-1699-4e7b-bebc-15f2494d9d23\") " pod="kube-system/global-pull-secret-syncer-vhsmf" Jul 06 21:04:16.308287 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.307421 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f38e9c39-8bb8-44e7-b69c-1da913bec44a-cnibin\") pod \"multus-24957\" (UID: \"f38e9c39-8bb8-44e7-b69c-1da913bec44a\") " pod="openshift-multus/multus-24957" Jul 06 21:04:16.308287 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.307440 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d1f73fe4-61a3-46b0-9221-4c49b9a74186-socket-dir\") pod \"aws-ebs-csi-driver-node-8xz26\" (UID: \"d1f73fe4-61a3-46b0-9221-4c49b9a74186\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xz26" Jul 06 21:04:16.308287 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.307442 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/67ff5eff-b2cf-45c9-ab38-9650657413b9-ovnkube-script-lib\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.309141 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:16.307465 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 21:04:16.309141 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.307482 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f38e9c39-8bb8-44e7-b69c-1da913bec44a-cnibin\") pod \"multus-24957\" (UID: \"f38e9c39-8bb8-44e7-b69c-1da913bec44a\") " pod="openshift-multus/multus-24957" Jul 06 21:04:16.309141 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.307486 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1cfb7af5-011a-4522-96bf-00eaf75fe18e-etc-sysctl-d\") pod \"tuned-lvxjl\" (UID: \"1cfb7af5-011a-4522-96bf-00eaf75fe18e\") " pod="openshift-cluster-node-tuning-operator/tuned-lvxjl" Jul 06 21:04:16.309141 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.307508 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a7028afb-6989-4fe8-a9a6-1230b13b505e-host\") pod \"node-ca-28sv5\" (UID: \"a7028afb-6989-4fe8-a9a6-1230b13b505e\") " pod="openshift-image-registry/node-ca-28sv5" Jul 06 21:04:16.309141 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:16.307547 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1dc41f0-1699-4e7b-bebc-15f2494d9d23-original-pull-secret podName:a1dc41f0-1699-4e7b-bebc-15f2494d9d23 nodeName:}" failed. No retries permitted until 2026-07-06 21:04:16.807520311 +0000 UTC m=+3.325758441 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a1dc41f0-1699-4e7b-bebc-15f2494d9d23-original-pull-secret") pod "global-pull-secret-syncer-vhsmf" (UID: "a1dc41f0-1699-4e7b-bebc-15f2494d9d23") : object "kube-system"/"original-pull-secret" not registered Jul 06 21:04:16.309141 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.307554 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a7028afb-6989-4fe8-a9a6-1230b13b505e-host\") pod \"node-ca-28sv5\" (UID: \"a7028afb-6989-4fe8-a9a6-1230b13b505e\") " pod="openshift-image-registry/node-ca-28sv5" Jul 06 21:04:16.309141 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.307568 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25k7b\" (UniqueName: \"kubernetes.io/projected/34abb9cb-886c-4133-b204-c5c02d6dbdf6-kube-api-access-25k7b\") pod \"node-resolver-zhhvw\" (UID: \"34abb9cb-886c-4133-b204-c5c02d6dbdf6\") " pod="openshift-dns/node-resolver-zhhvw" Jul 06 21:04:16.309141 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.307600 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2d9510b7-6982-4ead-a75a-e5816ef5b9ab-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p2h5x\" (UID: \"2d9510b7-6982-4ead-a75a-e5816ef5b9ab\") " pod="openshift-multus/multus-additional-cni-plugins-p2h5x" Jul 06 21:04:16.309141 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.307618 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2d9510b7-6982-4ead-a75a-e5816ef5b9ab-cni-binary-copy\") pod \"multus-additional-cni-plugins-p2h5x\" (UID: \"2d9510b7-6982-4ead-a75a-e5816ef5b9ab\") " pod="openshift-multus/multus-additional-cni-plugins-p2h5x" Jul 06 21:04:16.309141 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.307626 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f38e9c39-8bb8-44e7-b69c-1da913bec44a-multus-socket-dir-parent\") pod \"multus-24957\" (UID: \"f38e9c39-8bb8-44e7-b69c-1da913bec44a\") " pod="openshift-multus/multus-24957" Jul 06 21:04:16.309141 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.307650 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xc9n6\" (UniqueName: \"kubernetes.io/projected/67ff5eff-b2cf-45c9-ab38-9650657413b9-kube-api-access-xc9n6\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.309141 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.307673 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1cfb7af5-011a-4522-96bf-00eaf75fe18e-etc-sysconfig\") pod \"tuned-lvxjl\" (UID: \"1cfb7af5-011a-4522-96bf-00eaf75fe18e\") " pod="openshift-cluster-node-tuning-operator/tuned-lvxjl" Jul 06 21:04:16.309141 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.307696 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/084dc07e-e49b-44e3-95cc-11e11c5037a5-metrics-certs\") pod \"network-metrics-daemon-c795j\" (UID: \"084dc07e-e49b-44e3-95cc-11e11c5037a5\") " pod="openshift-multus/network-metrics-daemon-c795j" Jul 06 21:04:16.309141 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.307719 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f38e9c39-8bb8-44e7-b69c-1da913bec44a-host-run-multus-certs\") pod \"multus-24957\" (UID: \"f38e9c39-8bb8-44e7-b69c-1da913bec44a\") " pod="openshift-multus/multus-24957" Jul 06 21:04:16.309141 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.307738 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f38e9c39-8bb8-44e7-b69c-1da913bec44a-multus-socket-dir-parent\") pod \"multus-24957\" (UID: \"f38e9c39-8bb8-44e7-b69c-1da913bec44a\") " pod="openshift-multus/multus-24957" Jul 06 21:04:16.309141 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.307742 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/67ff5eff-b2cf-45c9-ab38-9650657413b9-host-run-netns\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.309141 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.307779 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/67ff5eff-b2cf-45c9-ab38-9650657413b9-host-run-netns\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.309971 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.307773 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1cfb7af5-011a-4522-96bf-00eaf75fe18e-etc-modprobe-d\") pod \"tuned-lvxjl\" (UID: \"1cfb7af5-011a-4522-96bf-00eaf75fe18e\") " pod="openshift-cluster-node-tuning-operator/tuned-lvxjl" Jul 06 21:04:16.309971 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.307856 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1cfb7af5-011a-4522-96bf-00eaf75fe18e-etc-modprobe-d\") pod \"tuned-lvxjl\" (UID: \"1cfb7af5-011a-4522-96bf-00eaf75fe18e\") " pod="openshift-cluster-node-tuning-operator/tuned-lvxjl" Jul 06 21:04:16.309971 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.307651 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1cfb7af5-011a-4522-96bf-00eaf75fe18e-etc-sysctl-d\") pod \"tuned-lvxjl\" (UID: \"1cfb7af5-011a-4522-96bf-00eaf75fe18e\") " pod="openshift-cluster-node-tuning-operator/tuned-lvxjl" Jul 06 21:04:16.309971 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.307961 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1cfb7af5-011a-4522-96bf-00eaf75fe18e-etc-sysconfig\") pod \"tuned-lvxjl\" (UID: \"1cfb7af5-011a-4522-96bf-00eaf75fe18e\") " pod="openshift-cluster-node-tuning-operator/tuned-lvxjl" Jul 06 21:04:16.309971 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.307990 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1cfb7af5-011a-4522-96bf-00eaf75fe18e-etc-sysctl-conf\") pod \"tuned-lvxjl\" (UID: \"1cfb7af5-011a-4522-96bf-00eaf75fe18e\") " pod="openshift-cluster-node-tuning-operator/tuned-lvxjl" Jul 06 21:04:16.309971 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.307985 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/67ff5eff-b2cf-45c9-ab38-9650657413b9-ovnkube-script-lib\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.309971 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.308005 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f38e9c39-8bb8-44e7-b69c-1da913bec44a-host-run-multus-certs\") pod \"multus-24957\" (UID: \"f38e9c39-8bb8-44e7-b69c-1da913bec44a\") " pod="openshift-multus/multus-24957" Jul 06 21:04:16.309971 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.308017 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1cfb7af5-011a-4522-96bf-00eaf75fe18e-sys\") pod \"tuned-lvxjl\" (UID: \"1cfb7af5-011a-4522-96bf-00eaf75fe18e\") " pod="openshift-cluster-node-tuning-operator/tuned-lvxjl" Jul 06 21:04:16.309971 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.308044 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d9510b7-6982-4ead-a75a-e5816ef5b9ab-system-cni-dir\") pod \"multus-additional-cni-plugins-p2h5x\" (UID: \"2d9510b7-6982-4ead-a75a-e5816ef5b9ab\") " pod="openshift-multus/multus-additional-cni-plugins-p2h5x" Jul 06 21:04:16.309971 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.308045 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2d9510b7-6982-4ead-a75a-e5816ef5b9ab-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p2h5x\" (UID: \"2d9510b7-6982-4ead-a75a-e5816ef5b9ab\") " pod="openshift-multus/multus-additional-cni-plugins-p2h5x" Jul 06 21:04:16.309971 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.308055 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1cfb7af5-011a-4522-96bf-00eaf75fe18e-sys\") pod \"tuned-lvxjl\" (UID: \"1cfb7af5-011a-4522-96bf-00eaf75fe18e\") " pod="openshift-cluster-node-tuning-operator/tuned-lvxjl" Jul 06 21:04:16.309971 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.308066 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67ff5eff-b2cf-45c9-ab38-9650657413b9-host-run-ovn-kubernetes\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.309971 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:16.308090 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 21:04:16.309971 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.308093 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d9510b7-6982-4ead-a75a-e5816ef5b9ab-system-cni-dir\") pod \"multus-additional-cni-plugins-p2h5x\" (UID: \"2d9510b7-6982-4ead-a75a-e5816ef5b9ab\") " pod="openshift-multus/multus-additional-cni-plugins-p2h5x" Jul 06 21:04:16.309971 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.308104 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67ff5eff-b2cf-45c9-ab38-9650657413b9-host-run-ovn-kubernetes\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.309971 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.308138 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1cfb7af5-011a-4522-96bf-00eaf75fe18e-etc-sysctl-conf\") pod \"tuned-lvxjl\" (UID: \"1cfb7af5-011a-4522-96bf-00eaf75fe18e\") " pod="openshift-cluster-node-tuning-operator/tuned-lvxjl" Jul 06 21:04:16.309971 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:16.308152 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/084dc07e-e49b-44e3-95cc-11e11c5037a5-metrics-certs podName:084dc07e-e49b-44e3-95cc-11e11c5037a5 nodeName:}" failed. No retries permitted until 2026-07-06 21:04:16.808134634 +0000 UTC m=+3.326372758 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/084dc07e-e49b-44e3-95cc-11e11c5037a5-metrics-certs") pod "network-metrics-daemon-c795j" (UID: "084dc07e-e49b-44e3-95cc-11e11c5037a5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 21:04:16.310597 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.308092 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d1f73fe4-61a3-46b0-9221-4c49b9a74186-etc-selinux\") pod \"aws-ebs-csi-driver-node-8xz26\" (UID: \"d1f73fe4-61a3-46b0-9221-4c49b9a74186\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xz26" Jul 06 21:04:16.310597 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.308188 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f38e9c39-8bb8-44e7-b69c-1da913bec44a-host-run-k8s-cni-cncf-io\") pod \"multus-24957\" (UID: \"f38e9c39-8bb8-44e7-b69c-1da913bec44a\") " pod="openshift-multus/multus-24957" Jul 06 21:04:16.310597 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.308191 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d1f73fe4-61a3-46b0-9221-4c49b9a74186-etc-selinux\") pod \"aws-ebs-csi-driver-node-8xz26\" (UID: \"d1f73fe4-61a3-46b0-9221-4c49b9a74186\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xz26" Jul 06 21:04:16.310597 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.308211 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1cfb7af5-011a-4522-96bf-00eaf75fe18e-run\") pod \"tuned-lvxjl\" (UID: \"1cfb7af5-011a-4522-96bf-00eaf75fe18e\") " pod="openshift-cluster-node-tuning-operator/tuned-lvxjl" Jul 06 21:04:16.310597 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.308234 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a1dc41f0-1699-4e7b-bebc-15f2494d9d23-dbus\") pod \"global-pull-secret-syncer-vhsmf\" (UID: \"a1dc41f0-1699-4e7b-bebc-15f2494d9d23\") " pod="kube-system/global-pull-secret-syncer-vhsmf" Jul 06 21:04:16.310597 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.308237 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f38e9c39-8bb8-44e7-b69c-1da913bec44a-host-run-k8s-cni-cncf-io\") pod \"multus-24957\" (UID: \"f38e9c39-8bb8-44e7-b69c-1da913bec44a\") " pod="openshift-multus/multus-24957" Jul 06 21:04:16.310597 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.308280 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1cfb7af5-011a-4522-96bf-00eaf75fe18e-run\") pod \"tuned-lvxjl\" (UID: \"1cfb7af5-011a-4522-96bf-00eaf75fe18e\") " pod="openshift-cluster-node-tuning-operator/tuned-lvxjl" Jul 06 21:04:16.310597 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.308289 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6795ede2-22ae-4bd6-932a-f1b7ff2a54ed-iptables-alerter-script\") pod \"iptables-alerter-hnqfz\" (UID: \"6795ede2-22ae-4bd6-932a-f1b7ff2a54ed\") " pod="openshift-network-operator/iptables-alerter-hnqfz" Jul 06 21:04:16.310597 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.308328 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f38e9c39-8bb8-44e7-b69c-1da913bec44a-cni-binary-copy\") pod \"multus-24957\" (UID: \"f38e9c39-8bb8-44e7-b69c-1da913bec44a\") " pod="openshift-multus/multus-24957" Jul 06 21:04:16.310597 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.308349 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/67ff5eff-b2cf-45c9-ab38-9650657413b9-systemd-units\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.310597 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.308350 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a1dc41f0-1699-4e7b-bebc-15f2494d9d23-dbus\") pod \"global-pull-secret-syncer-vhsmf\" (UID: \"a1dc41f0-1699-4e7b-bebc-15f2494d9d23\") " pod="kube-system/global-pull-secret-syncer-vhsmf" Jul 06 21:04:16.310597 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.308387 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/67ff5eff-b2cf-45c9-ab38-9650657413b9-systemd-units\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.310597 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.308401 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/67ff5eff-b2cf-45c9-ab38-9650657413b9-host-slash\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.310597 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.308421 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2d9510b7-6982-4ead-a75a-e5816ef5b9ab-cnibin\") pod \"multus-additional-cni-plugins-p2h5x\" (UID: \"2d9510b7-6982-4ead-a75a-e5816ef5b9ab\") " pod="openshift-multus/multus-additional-cni-plugins-p2h5x" Jul 06 21:04:16.310597 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.308436 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gknv\" (UniqueName: \"kubernetes.io/projected/084dc07e-e49b-44e3-95cc-11e11c5037a5-kube-api-access-4gknv\") pod \"network-metrics-daemon-c795j\" (UID: \"084dc07e-e49b-44e3-95cc-11e11c5037a5\") " pod="openshift-multus/network-metrics-daemon-c795j" Jul 06 21:04:16.310597 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.308453 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/67ff5eff-b2cf-45c9-ab38-9650657413b9-run-systemd\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.310597 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.308477 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8drhf\" (UniqueName: \"kubernetes.io/projected/f107cce5-b80b-4c37-9d88-e582acb83168-kube-api-access-8drhf\") pod \"network-check-target-lvgtq\" (UID: \"f107cce5-b80b-4c37-9d88-e582acb83168\") " pod="openshift-network-diagnostics/network-check-target-lvgtq" Jul 06 21:04:16.311141 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.308485 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2d9510b7-6982-4ead-a75a-e5816ef5b9ab-cnibin\") pod \"multus-additional-cni-plugins-p2h5x\" (UID: \"2d9510b7-6982-4ead-a75a-e5816ef5b9ab\") " pod="openshift-multus/multus-additional-cni-plugins-p2h5x" Jul 06 21:04:16.311141 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.308501 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/67ff5eff-b2cf-45c9-ab38-9650657413b9-run-systemd\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.311141 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.308501 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lb6sc\" (UniqueName: \"kubernetes.io/projected/6795ede2-22ae-4bd6-932a-f1b7ff2a54ed-kube-api-access-lb6sc\") pod \"iptables-alerter-hnqfz\" (UID: \"6795ede2-22ae-4bd6-932a-f1b7ff2a54ed\") " pod="openshift-network-operator/iptables-alerter-hnqfz" Jul 06 21:04:16.311141 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.308525 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/67ff5eff-b2cf-45c9-ab38-9650657413b9-host-slash\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.311141 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.308543 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/67ff5eff-b2cf-45c9-ab38-9650657413b9-run-ovn\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.311141 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.308570 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/67ff5eff-b2cf-45c9-ab38-9650657413b9-host-cni-bin\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.311141 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.308595 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/67ff5eff-b2cf-45c9-ab38-9650657413b9-env-overrides\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.311141 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.308647 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/67ff5eff-b2cf-45c9-ab38-9650657413b9-ovn-node-metrics-cert\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.311141 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.308673 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1cfb7af5-011a-4522-96bf-00eaf75fe18e-etc-tuned\") pod \"tuned-lvxjl\" (UID: \"1cfb7af5-011a-4522-96bf-00eaf75fe18e\") " pod="openshift-cluster-node-tuning-operator/tuned-lvxjl" Jul 06 21:04:16.311141 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.308659 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/67ff5eff-b2cf-45c9-ab38-9650657413b9-host-cni-bin\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.311141 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.308699 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2d9510b7-6982-4ead-a75a-e5816ef5b9ab-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p2h5x\" (UID: \"2d9510b7-6982-4ead-a75a-e5816ef5b9ab\") " pod="openshift-multus/multus-additional-cni-plugins-p2h5x" Jul 06 21:04:16.311141 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.308722 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/67ff5eff-b2cf-45c9-ab38-9650657413b9-run-ovn\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.311141 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.308726 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f38e9c39-8bb8-44e7-b69c-1da913bec44a-os-release\") pod \"multus-24957\" (UID: \"f38e9c39-8bb8-44e7-b69c-1da913bec44a\") " pod="openshift-multus/multus-24957" Jul 06 21:04:16.311141 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.308755 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67ff5eff-b2cf-45c9-ab38-9650657413b9-var-lib-openvswitch\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.311141 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.308780 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/67ff5eff-b2cf-45c9-ab38-9650657413b9-ovnkube-config\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.311141 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.308802 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1cfb7af5-011a-4522-96bf-00eaf75fe18e-var-lib-kubelet\") pod \"tuned-lvxjl\" (UID: \"1cfb7af5-011a-4522-96bf-00eaf75fe18e\") " pod="openshift-cluster-node-tuning-operator/tuned-lvxjl" Jul 06 21:04:16.311141 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.308827 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a1dc41f0-1699-4e7b-bebc-15f2494d9d23-kubelet-config\") pod \"global-pull-secret-syncer-vhsmf\" (UID: \"a1dc41f0-1699-4e7b-bebc-15f2494d9d23\") " pod="kube-system/global-pull-secret-syncer-vhsmf" Jul 06 21:04:16.311711 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.308851 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a58f0fcd-7bf3-4366-b3b2-622f57f9253b-konnectivity-ca\") pod \"konnectivity-agent-x7g5w\" (UID: \"a58f0fcd-7bf3-4366-b3b2-622f57f9253b\") " pod="kube-system/konnectivity-agent-x7g5w" Jul 06 21:04:16.311711 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.308854 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6795ede2-22ae-4bd6-932a-f1b7ff2a54ed-iptables-alerter-script\") pod \"iptables-alerter-hnqfz\" (UID: \"6795ede2-22ae-4bd6-932a-f1b7ff2a54ed\") " pod="openshift-network-operator/iptables-alerter-hnqfz" Jul 06 21:04:16.311711 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.308885 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f38e9c39-8bb8-44e7-b69c-1da913bec44a-multus-cni-dir\") pod \"multus-24957\" (UID: \"f38e9c39-8bb8-44e7-b69c-1da913bec44a\") " pod="openshift-multus/multus-24957" Jul 06 21:04:16.311711 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.308910 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f38e9c39-8bb8-44e7-b69c-1da913bec44a-multus-daemon-config\") pod \"multus-24957\" (UID: \"f38e9c39-8bb8-44e7-b69c-1da913bec44a\") " pod="openshift-multus/multus-24957" Jul 06 21:04:16.311711 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.308934 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d1f73fe4-61a3-46b0-9221-4c49b9a74186-device-dir\") pod \"aws-ebs-csi-driver-node-8xz26\" (UID: \"d1f73fe4-61a3-46b0-9221-4c49b9a74186\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xz26" Jul 06 21:04:16.311711 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.308987 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bn678\" (UniqueName: \"kubernetes.io/projected/f38e9c39-8bb8-44e7-b69c-1da913bec44a-kube-api-access-bn678\") pod \"multus-24957\" (UID: \"f38e9c39-8bb8-44e7-b69c-1da913bec44a\") " pod="openshift-multus/multus-24957" Jul 06 21:04:16.311711 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.309003 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f38e9c39-8bb8-44e7-b69c-1da913bec44a-os-release\") pod \"multus-24957\" (UID: \"f38e9c39-8bb8-44e7-b69c-1da913bec44a\") " pod="openshift-multus/multus-24957" Jul 06 21:04:16.311711 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.309013 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a7028afb-6989-4fe8-a9a6-1230b13b505e-serviceca\") pod \"node-ca-28sv5\" (UID: \"a7028afb-6989-4fe8-a9a6-1230b13b505e\") " pod="openshift-image-registry/node-ca-28sv5" Jul 06 21:04:16.311711 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.309030 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2d9510b7-6982-4ead-a75a-e5816ef5b9ab-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p2h5x\" (UID: \"2d9510b7-6982-4ead-a75a-e5816ef5b9ab\") " pod="openshift-multus/multus-additional-cni-plugins-p2h5x" Jul 06 21:04:16.311711 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.309036 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34abb9cb-886c-4133-b204-c5c02d6dbdf6-tmp-dir\") pod \"node-resolver-zhhvw\" (UID: \"34abb9cb-886c-4133-b204-c5c02d6dbdf6\") " pod="openshift-dns/node-resolver-zhhvw" Jul 06 21:04:16.311711 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.309079 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2d9510b7-6982-4ead-a75a-e5816ef5b9ab-os-release\") pod \"multus-additional-cni-plugins-p2h5x\" (UID: \"2d9510b7-6982-4ead-a75a-e5816ef5b9ab\") " pod="openshift-multus/multus-additional-cni-plugins-p2h5x" Jul 06 21:04:16.311711 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.309108 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffjc9\" (UniqueName: \"kubernetes.io/projected/2d9510b7-6982-4ead-a75a-e5816ef5b9ab-kube-api-access-ffjc9\") pod \"multus-additional-cni-plugins-p2h5x\" (UID: \"2d9510b7-6982-4ead-a75a-e5816ef5b9ab\") " pod="openshift-multus/multus-additional-cni-plugins-p2h5x" Jul 06 21:04:16.311711 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.309126 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67ff5eff-b2cf-45c9-ab38-9650657413b9-var-lib-openvswitch\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.311711 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.309137 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1cfb7af5-011a-4522-96bf-00eaf75fe18e-etc-systemd\") pod \"tuned-lvxjl\" (UID: \"1cfb7af5-011a-4522-96bf-00eaf75fe18e\") " pod="openshift-cluster-node-tuning-operator/tuned-lvxjl" Jul 06 21:04:16.311711 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.309174 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67ff5eff-b2cf-45c9-ab38-9650657413b9-run-openvswitch\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.311711 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.309180 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1cfb7af5-011a-4522-96bf-00eaf75fe18e-etc-systemd\") pod \"tuned-lvxjl\" (UID: \"1cfb7af5-011a-4522-96bf-00eaf75fe18e\") " pod="openshift-cluster-node-tuning-operator/tuned-lvxjl" Jul 06 21:04:16.311711 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.309203 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6795ede2-22ae-4bd6-932a-f1b7ff2a54ed-host-slash\") pod \"iptables-alerter-hnqfz\" (UID: \"6795ede2-22ae-4bd6-932a-f1b7ff2a54ed\") " pod="openshift-network-operator/iptables-alerter-hnqfz" Jul 06 21:04:16.312162 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.309232 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2d9510b7-6982-4ead-a75a-e5816ef5b9ab-os-release\") pod \"multus-additional-cni-plugins-p2h5x\" (UID: \"2d9510b7-6982-4ead-a75a-e5816ef5b9ab\") " pod="openshift-multus/multus-additional-cni-plugins-p2h5x" Jul 06 21:04:16.312162 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.309078 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/67ff5eff-b2cf-45c9-ab38-9650657413b9-env-overrides\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.312162 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.309271 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67ff5eff-b2cf-45c9-ab38-9650657413b9-run-openvswitch\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.312162 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.309325 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6795ede2-22ae-4bd6-932a-f1b7ff2a54ed-host-slash\") pod \"iptables-alerter-hnqfz\" (UID: \"6795ede2-22ae-4bd6-932a-f1b7ff2a54ed\") " pod="openshift-network-operator/iptables-alerter-hnqfz" Jul 06 21:04:16.312162 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.309336 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34abb9cb-886c-4133-b204-c5c02d6dbdf6-tmp-dir\") pod \"node-resolver-zhhvw\" (UID: \"34abb9cb-886c-4133-b204-c5c02d6dbdf6\") " pod="openshift-dns/node-resolver-zhhvw" Jul 06 21:04:16.312162 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.309441 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a1dc41f0-1699-4e7b-bebc-15f2494d9d23-kubelet-config\") pod \"global-pull-secret-syncer-vhsmf\" (UID: \"a1dc41f0-1699-4e7b-bebc-15f2494d9d23\") " pod="kube-system/global-pull-secret-syncer-vhsmf" Jul 06 21:04:16.312162 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.309495 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1cfb7af5-011a-4522-96bf-00eaf75fe18e-var-lib-kubelet\") pod \"tuned-lvxjl\" (UID: \"1cfb7af5-011a-4522-96bf-00eaf75fe18e\") " pod="openshift-cluster-node-tuning-operator/tuned-lvxjl" Jul 06 21:04:16.312162 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.308933 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f38e9c39-8bb8-44e7-b69c-1da913bec44a-cni-binary-copy\") pod \"multus-24957\" (UID: \"f38e9c39-8bb8-44e7-b69c-1da913bec44a\") " pod="openshift-multus/multus-24957" Jul 06 21:04:16.312162 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.309559 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d1f73fe4-61a3-46b0-9221-4c49b9a74186-device-dir\") pod \"aws-ebs-csi-driver-node-8xz26\" (UID: \"d1f73fe4-61a3-46b0-9221-4c49b9a74186\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xz26" Jul 06 21:04:16.312162 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.309816 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f38e9c39-8bb8-44e7-b69c-1da913bec44a-multus-daemon-config\") pod \"multus-24957\" (UID: \"f38e9c39-8bb8-44e7-b69c-1da913bec44a\") " pod="openshift-multus/multus-24957" Jul 06 21:04:16.312162 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.309828 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/67ff5eff-b2cf-45c9-ab38-9650657413b9-ovnkube-config\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.312162 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.309907 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f38e9c39-8bb8-44e7-b69c-1da913bec44a-multus-cni-dir\") pod \"multus-24957\" (UID: \"f38e9c39-8bb8-44e7-b69c-1da913bec44a\") " pod="openshift-multus/multus-24957" Jul 06 21:04:16.312162 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.310077 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a58f0fcd-7bf3-4366-b3b2-622f57f9253b-konnectivity-ca\") pod \"konnectivity-agent-x7g5w\" (UID: \"a58f0fcd-7bf3-4366-b3b2-622f57f9253b\") " pod="kube-system/konnectivity-agent-x7g5w" Jul 06 21:04:16.312162 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.310334 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a7028afb-6989-4fe8-a9a6-1230b13b505e-serviceca\") pod \"node-ca-28sv5\" (UID: \"a7028afb-6989-4fe8-a9a6-1230b13b505e\") " pod="openshift-image-registry/node-ca-28sv5" Jul 06 21:04:16.312162 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.310699 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1cfb7af5-011a-4522-96bf-00eaf75fe18e-tmp\") pod \"tuned-lvxjl\" (UID: \"1cfb7af5-011a-4522-96bf-00eaf75fe18e\") " pod="openshift-cluster-node-tuning-operator/tuned-lvxjl" Jul 06 21:04:16.312162 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.310978 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a58f0fcd-7bf3-4366-b3b2-622f57f9253b-agent-certs\") pod \"konnectivity-agent-x7g5w\" (UID: \"a58f0fcd-7bf3-4366-b3b2-622f57f9253b\") " pod="kube-system/konnectivity-agent-x7g5w" Jul 06 21:04:16.312162 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.310985 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1cfb7af5-011a-4522-96bf-00eaf75fe18e-etc-tuned\") pod \"tuned-lvxjl\" (UID: \"1cfb7af5-011a-4522-96bf-00eaf75fe18e\") " pod="openshift-cluster-node-tuning-operator/tuned-lvxjl" Jul 06 21:04:16.312162 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.311185 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/67ff5eff-b2cf-45c9-ab38-9650657413b9-ovn-node-metrics-cert\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.349828 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.349795 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-25k7b\" (UniqueName: \"kubernetes.io/projected/34abb9cb-886c-4133-b204-c5c02d6dbdf6-kube-api-access-25k7b\") pod \"node-resolver-zhhvw\" (UID: \"34abb9cb-886c-4133-b204-c5c02d6dbdf6\") " pod="openshift-dns/node-resolver-zhhvw" Jul 06 21:04:16.371389 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:16.371364 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 21:04:16.371389 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:16.371390 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 21:04:16.371389 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:16.371404 2563 projected.go:196] Error preparing data for projected volume kube-api-access-8drhf for pod openshift-network-diagnostics/network-check-target-lvgtq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 21:04:16.371691 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:16.371480 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f107cce5-b80b-4c37-9d88-e582acb83168-kube-api-access-8drhf podName:f107cce5-b80b-4c37-9d88-e582acb83168 nodeName:}" failed. No retries permitted until 2026-07-06 21:04:16.871460839 +0000 UTC m=+3.389698967 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8drhf" (UniqueName: "kubernetes.io/projected/f107cce5-b80b-4c37-9d88-e582acb83168-kube-api-access-8drhf") pod "network-check-target-lvgtq" (UID: "f107cce5-b80b-4c37-9d88-e582acb83168") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 21:04:16.371691 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.371581 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bn678\" (UniqueName: \"kubernetes.io/projected/f38e9c39-8bb8-44e7-b69c-1da913bec44a-kube-api-access-bn678\") pod \"multus-24957\" (UID: \"f38e9c39-8bb8-44e7-b69c-1da913bec44a\") " pod="openshift-multus/multus-24957" Jul 06 21:04:16.372424 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.372403 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrg6d\" (UniqueName: \"kubernetes.io/projected/a7028afb-6989-4fe8-a9a6-1230b13b505e-kube-api-access-hrg6d\") pod \"node-ca-28sv5\" (UID: \"a7028afb-6989-4fe8-a9a6-1230b13b505e\") " pod="openshift-image-registry/node-ca-28sv5" Jul 06 21:04:16.372540 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.372523 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lb6sc\" (UniqueName: \"kubernetes.io/projected/6795ede2-22ae-4bd6-932a-f1b7ff2a54ed-kube-api-access-lb6sc\") pod \"iptables-alerter-hnqfz\" (UID: \"6795ede2-22ae-4bd6-932a-f1b7ff2a54ed\") " pod="openshift-network-operator/iptables-alerter-hnqfz" Jul 06 21:04:16.374603 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.374577 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-npbz2\" (UniqueName: \"kubernetes.io/projected/d1f73fe4-61a3-46b0-9221-4c49b9a74186-kube-api-access-npbz2\") pod \"aws-ebs-csi-driver-node-8xz26\" (UID: \"d1f73fe4-61a3-46b0-9221-4c49b9a74186\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xz26" Jul 06 21:04:16.375262 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.375238 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gknv\" (UniqueName: \"kubernetes.io/projected/084dc07e-e49b-44e3-95cc-11e11c5037a5-kube-api-access-4gknv\") pod \"network-metrics-daemon-c795j\" (UID: \"084dc07e-e49b-44e3-95cc-11e11c5037a5\") " pod="openshift-multus/network-metrics-daemon-c795j" Jul 06 21:04:16.375369 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.375326 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh4h9\" (UniqueName: \"kubernetes.io/projected/1cfb7af5-011a-4522-96bf-00eaf75fe18e-kube-api-access-dh4h9\") pod \"tuned-lvxjl\" (UID: \"1cfb7af5-011a-4522-96bf-00eaf75fe18e\") " pod="openshift-cluster-node-tuning-operator/tuned-lvxjl" Jul 06 21:04:16.375742 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.375727 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffjc9\" (UniqueName: \"kubernetes.io/projected/2d9510b7-6982-4ead-a75a-e5816ef5b9ab-kube-api-access-ffjc9\") pod \"multus-additional-cni-plugins-p2h5x\" (UID: \"2d9510b7-6982-4ead-a75a-e5816ef5b9ab\") " pod="openshift-multus/multus-additional-cni-plugins-p2h5x" Jul 06 21:04:16.379166 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.379148 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc9n6\" (UniqueName: \"kubernetes.io/projected/67ff5eff-b2cf-45c9-ab38-9650657413b9-kube-api-access-xc9n6\") pod \"ovnkube-node-nsmng\" (UID: \"67ff5eff-b2cf-45c9-ab38-9650657413b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.427938 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.427910 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-24957" Jul 06 21:04:16.431763 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.431746 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xz26" Jul 06 21:04:16.437400 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:16.437377 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf38e9c39_8bb8_44e7_b69c_1da913bec44a.slice/crio-eedb551135afe091a2f091c081aa30e4a75113d257f4a500e04dd215375614c3 WatchSource:0}: Error finding container eedb551135afe091a2f091c081aa30e4a75113d257f4a500e04dd215375614c3: Status 404 returned error can't find the container with id eedb551135afe091a2f091c081aa30e4a75113d257f4a500e04dd215375614c3 Jul 06 21:04:16.439533 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.439514 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:16.440385 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:16.440359 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1f73fe4_61a3_46b0_9221_4c49b9a74186.slice/crio-bb34d24975cdce88cb5c7f152f990180f00b00f3065e03d6c8a3a5655c094763 WatchSource:0}: Error finding container bb34d24975cdce88cb5c7f152f990180f00b00f3065e03d6c8a3a5655c094763: Status 404 returned error can't find the container with id bb34d24975cdce88cb5c7f152f990180f00b00f3065e03d6c8a3a5655c094763 Jul 06 21:04:16.443502 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.443486 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lvxjl" Jul 06 21:04:16.448199 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.448182 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-28sv5" Jul 06 21:04:16.448509 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:16.448491 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67ff5eff_b2cf_45c9_ab38_9650657413b9.slice/crio-4ace42864439daaeac938218f3860ec0f5e31f6bdba728d91052116b1daa71fc WatchSource:0}: Error finding container 4ace42864439daaeac938218f3860ec0f5e31f6bdba728d91052116b1daa71fc: Status 404 returned error can't find the container with id 4ace42864439daaeac938218f3860ec0f5e31f6bdba728d91052116b1daa71fc Jul 06 21:04:16.453686 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.453667 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zhhvw" Jul 06 21:04:16.455039 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:16.455012 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cfb7af5_011a_4522_96bf_00eaf75fe18e.slice/crio-4df4f22cf74cedae39f2f6cde9a1a5bf98e0084135525b64cadfc75736f650a7 WatchSource:0}: Error finding container 4df4f22cf74cedae39f2f6cde9a1a5bf98e0084135525b64cadfc75736f650a7: Status 404 returned error can't find the container with id 4df4f22cf74cedae39f2f6cde9a1a5bf98e0084135525b64cadfc75736f650a7 Jul 06 21:04:16.458583 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:16.458565 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7028afb_6989_4fe8_a9a6_1230b13b505e.slice/crio-aadd0b6f9218eacdeb8e53cbffdc7abeb1b90c510ea240f75c55711d97a5d860 WatchSource:0}: Error finding container aadd0b6f9218eacdeb8e53cbffdc7abeb1b90c510ea240f75c55711d97a5d860: Status 404 returned error can't find the container with id aadd0b6f9218eacdeb8e53cbffdc7abeb1b90c510ea240f75c55711d97a5d860 Jul 06 21:04:16.460652 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.460631 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-p2h5x" Jul 06 21:04:16.463059 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:16.463039 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34abb9cb_886c_4133_b204_c5c02d6dbdf6.slice/crio-800839289bcb55f83e9f1cb50e77e3d26baf27928f0cd84739d3aafc2241764b WatchSource:0}: Error finding container 800839289bcb55f83e9f1cb50e77e3d26baf27928f0cd84739d3aafc2241764b: Status 404 returned error can't find the container with id 800839289bcb55f83e9f1cb50e77e3d26baf27928f0cd84739d3aafc2241764b Jul 06 21:04:16.465226 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.465212 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hnqfz" Jul 06 21:04:16.467893 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:16.467872 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d9510b7_6982_4ead_a75a_e5816ef5b9ab.slice/crio-52c55f2f3559296f035a2cd6e54faf472d757576c23069c1cab368a17771164b WatchSource:0}: Error finding container 52c55f2f3559296f035a2cd6e54faf472d757576c23069c1cab368a17771164b: Status 404 returned error can't find the container with id 52c55f2f3559296f035a2cd6e54faf472d757576c23069c1cab368a17771164b Jul 06 21:04:16.469865 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.469841 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-x7g5w" Jul 06 21:04:16.472962 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:16.472940 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6795ede2_22ae_4bd6_932a_f1b7ff2a54ed.slice/crio-ca8247a4b5a97b59888848dd4e99a40a50e70a4f58cf155d1654e8b7c1bc0f58 WatchSource:0}: Error finding container ca8247a4b5a97b59888848dd4e99a40a50e70a4f58cf155d1654e8b7c1bc0f58: Status 404 returned error can't find the container with id ca8247a4b5a97b59888848dd4e99a40a50e70a4f58cf155d1654e8b7c1bc0f58 Jul 06 21:04:16.479166 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:16.479142 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda58f0fcd_7bf3_4366_b3b2_622f57f9253b.slice/crio-cf6d7c3bfece97e0180c22d8a23c038fdcc55e187900fd910b92729e9e1d2dff WatchSource:0}: Error finding container cf6d7c3bfece97e0180c22d8a23c038fdcc55e187900fd910b92729e9e1d2dff: Status 404 returned error can't find the container with id cf6d7c3bfece97e0180c22d8a23c038fdcc55e187900fd910b92729e9e1d2dff Jul 06 21:04:16.813886 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.813855 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1dc41f0-1699-4e7b-bebc-15f2494d9d23-original-pull-secret\") pod \"global-pull-secret-syncer-vhsmf\" (UID: \"a1dc41f0-1699-4e7b-bebc-15f2494d9d23\") " pod="kube-system/global-pull-secret-syncer-vhsmf" Jul 06 21:04:16.814024 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.813897 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/084dc07e-e49b-44e3-95cc-11e11c5037a5-metrics-certs\") pod \"network-metrics-daemon-c795j\" (UID: \"084dc07e-e49b-44e3-95cc-11e11c5037a5\") " pod="openshift-multus/network-metrics-daemon-c795j" Jul 06 21:04:16.814024 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:16.814003 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 21:04:16.814110 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:16.814061 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1dc41f0-1699-4e7b-bebc-15f2494d9d23-original-pull-secret podName:a1dc41f0-1699-4e7b-bebc-15f2494d9d23 nodeName:}" failed. No retries permitted until 2026-07-06 21:04:17.814048548 +0000 UTC m=+4.332286662 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a1dc41f0-1699-4e7b-bebc-15f2494d9d23-original-pull-secret") pod "global-pull-secret-syncer-vhsmf" (UID: "a1dc41f0-1699-4e7b-bebc-15f2494d9d23") : object "kube-system"/"original-pull-secret" not registered Jul 06 21:04:16.814110 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:16.814002 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 21:04:16.814194 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:16.814118 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/084dc07e-e49b-44e3-95cc-11e11c5037a5-metrics-certs podName:084dc07e-e49b-44e3-95cc-11e11c5037a5 nodeName:}" failed. No retries permitted until 2026-07-06 21:04:17.814105953 +0000 UTC m=+4.332344070 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/084dc07e-e49b-44e3-95cc-11e11c5037a5-metrics-certs") pod "network-metrics-daemon-c795j" (UID: "084dc07e-e49b-44e3-95cc-11e11c5037a5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 21:04:16.914614 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:16.914576 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8drhf\" (UniqueName: \"kubernetes.io/projected/f107cce5-b80b-4c37-9d88-e582acb83168-kube-api-access-8drhf\") pod \"network-check-target-lvgtq\" (UID: \"f107cce5-b80b-4c37-9d88-e582acb83168\") " pod="openshift-network-diagnostics/network-check-target-lvgtq" Jul 06 21:04:16.914802 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:16.914742 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 21:04:16.914802 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:16.914762 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 21:04:16.914802 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:16.914775 2563 projected.go:196] Error preparing data for projected volume kube-api-access-8drhf for pod openshift-network-diagnostics/network-check-target-lvgtq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 21:04:16.914963 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:16.914834 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f107cce5-b80b-4c37-9d88-e582acb83168-kube-api-access-8drhf podName:f107cce5-b80b-4c37-9d88-e582acb83168 nodeName:}" failed. No retries permitted until 2026-07-06 21:04:17.914816149 +0000 UTC m=+4.433054261 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8drhf" (UniqueName: "kubernetes.io/projected/f107cce5-b80b-4c37-9d88-e582acb83168-kube-api-access-8drhf") pod "network-check-target-lvgtq" (UID: "f107cce5-b80b-4c37-9d88-e582acb83168") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 21:04:17.115140 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:17.114974 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-x7g5w" event={"ID":"a58f0fcd-7bf3-4366-b3b2-622f57f9253b","Type":"ContainerStarted","Data":"cf6d7c3bfece97e0180c22d8a23c038fdcc55e187900fd910b92729e9e1d2dff"} Jul 06 21:04:17.121101 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:17.121070 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hnqfz" event={"ID":"6795ede2-22ae-4bd6-932a-f1b7ff2a54ed","Type":"ContainerStarted","Data":"ca8247a4b5a97b59888848dd4e99a40a50e70a4f58cf155d1654e8b7c1bc0f58"} Jul 06 21:04:17.125779 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:17.125751 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p2h5x" event={"ID":"2d9510b7-6982-4ead-a75a-e5816ef5b9ab","Type":"ContainerStarted","Data":"52c55f2f3559296f035a2cd6e54faf472d757576c23069c1cab368a17771164b"} Jul 06 21:04:17.127845 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:17.127724 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" event={"ID":"67ff5eff-b2cf-45c9-ab38-9650657413b9","Type":"ContainerStarted","Data":"4ace42864439daaeac938218f3860ec0f5e31f6bdba728d91052116b1daa71fc"} Jul 06 21:04:17.131819 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:17.131741 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-24957" event={"ID":"f38e9c39-8bb8-44e7-b69c-1da913bec44a","Type":"ContainerStarted","Data":"eedb551135afe091a2f091c081aa30e4a75113d257f4a500e04dd215375614c3"} Jul 06 21:04:17.136062 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:17.136035 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zhhvw" event={"ID":"34abb9cb-886c-4133-b204-c5c02d6dbdf6","Type":"ContainerStarted","Data":"800839289bcb55f83e9f1cb50e77e3d26baf27928f0cd84739d3aafc2241764b"} Jul 06 21:04:17.140125 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:17.140098 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-28sv5" event={"ID":"a7028afb-6989-4fe8-a9a6-1230b13b505e","Type":"ContainerStarted","Data":"aadd0b6f9218eacdeb8e53cbffdc7abeb1b90c510ea240f75c55711d97a5d860"} Jul 06 21:04:17.148203 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:17.148176 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lvxjl" event={"ID":"1cfb7af5-011a-4522-96bf-00eaf75fe18e","Type":"ContainerStarted","Data":"4df4f22cf74cedae39f2f6cde9a1a5bf98e0084135525b64cadfc75736f650a7"} Jul 06 21:04:17.154174 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:17.154122 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 20:59:16 +0000 UTC" deadline="2028-03-03 01:10:53.381790738 +0000 UTC" Jul 06 21:04:17.154174 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:17.154175 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14524h6m36.227619682s" Jul 06 21:04:17.155712 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:17.155687 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xz26" event={"ID":"d1f73fe4-61a3-46b0-9221-4c49b9a74186","Type":"ContainerStarted","Data":"bb34d24975cdce88cb5c7f152f990180f00b00f3065e03d6c8a3a5655c094763"} Jul 06 21:04:17.823166 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:17.823121 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1dc41f0-1699-4e7b-bebc-15f2494d9d23-original-pull-secret\") pod \"global-pull-secret-syncer-vhsmf\" (UID: \"a1dc41f0-1699-4e7b-bebc-15f2494d9d23\") " pod="kube-system/global-pull-secret-syncer-vhsmf" Jul 06 21:04:17.823166 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:17.823172 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/084dc07e-e49b-44e3-95cc-11e11c5037a5-metrics-certs\") pod \"network-metrics-daemon-c795j\" (UID: \"084dc07e-e49b-44e3-95cc-11e11c5037a5\") " pod="openshift-multus/network-metrics-daemon-c795j" Jul 06 21:04:17.823433 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:17.823345 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 21:04:17.823433 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:17.823409 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/084dc07e-e49b-44e3-95cc-11e11c5037a5-metrics-certs podName:084dc07e-e49b-44e3-95cc-11e11c5037a5 nodeName:}" failed. No retries permitted until 2026-07-06 21:04:19.823390322 +0000 UTC m=+6.341628438 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/084dc07e-e49b-44e3-95cc-11e11c5037a5-metrics-certs") pod "network-metrics-daemon-c795j" (UID: "084dc07e-e49b-44e3-95cc-11e11c5037a5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 21:04:17.823963 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:17.823783 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 21:04:17.823963 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:17.823831 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1dc41f0-1699-4e7b-bebc-15f2494d9d23-original-pull-secret podName:a1dc41f0-1699-4e7b-bebc-15f2494d9d23 nodeName:}" failed. No retries permitted until 2026-07-06 21:04:19.823816672 +0000 UTC m=+6.342054796 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a1dc41f0-1699-4e7b-bebc-15f2494d9d23-original-pull-secret") pod "global-pull-secret-syncer-vhsmf" (UID: "a1dc41f0-1699-4e7b-bebc-15f2494d9d23") : object "kube-system"/"original-pull-secret" not registered Jul 06 21:04:17.924793 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:17.924068 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8drhf\" (UniqueName: \"kubernetes.io/projected/f107cce5-b80b-4c37-9d88-e582acb83168-kube-api-access-8drhf\") pod \"network-check-target-lvgtq\" (UID: \"f107cce5-b80b-4c37-9d88-e582acb83168\") " pod="openshift-network-diagnostics/network-check-target-lvgtq" Jul 06 21:04:17.924793 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:17.924238 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 21:04:17.924793 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:17.924261 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 21:04:17.924793 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:17.924274 2563 projected.go:196] Error preparing data for projected volume kube-api-access-8drhf for pod openshift-network-diagnostics/network-check-target-lvgtq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 21:04:17.924793 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:17.924359 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f107cce5-b80b-4c37-9d88-e582acb83168-kube-api-access-8drhf podName:f107cce5-b80b-4c37-9d88-e582acb83168 nodeName:}" failed. No retries permitted until 2026-07-06 21:04:19.924340262 +0000 UTC m=+6.442578408 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8drhf" (UniqueName: "kubernetes.io/projected/f107cce5-b80b-4c37-9d88-e582acb83168-kube-api-access-8drhf") pod "network-check-target-lvgtq" (UID: "f107cce5-b80b-4c37-9d88-e582acb83168") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 21:04:18.029852 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:18.029823 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvgtq" Jul 06 21:04:18.030020 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:18.029823 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhsmf" Jul 06 21:04:18.030020 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:18.029971 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c795j" Jul 06 21:04:18.030020 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:18.029968 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvgtq" podUID="f107cce5-b80b-4c37-9d88-e582acb83168" Jul 06 21:04:18.030185 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:18.030070 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhsmf" podUID="a1dc41f0-1699-4e7b-bebc-15f2494d9d23" Jul 06 21:04:18.030185 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:18.030152 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c795j" podUID="084dc07e-e49b-44e3-95cc-11e11c5037a5" Jul 06 21:04:18.154639 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:18.154553 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 20:59:16 +0000 UTC" deadline="2028-04-09 05:16:04.772139474 +0000 UTC" Jul 06 21:04:18.154639 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:18.154597 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15416h11m46.617547987s" Jul 06 21:04:19.845163 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:19.845120 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1dc41f0-1699-4e7b-bebc-15f2494d9d23-original-pull-secret\") pod \"global-pull-secret-syncer-vhsmf\" (UID: \"a1dc41f0-1699-4e7b-bebc-15f2494d9d23\") " pod="kube-system/global-pull-secret-syncer-vhsmf" Jul 06 21:04:19.845648 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:19.845185 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/084dc07e-e49b-44e3-95cc-11e11c5037a5-metrics-certs\") pod \"network-metrics-daemon-c795j\" (UID: \"084dc07e-e49b-44e3-95cc-11e11c5037a5\") " pod="openshift-multus/network-metrics-daemon-c795j" Jul 06 21:04:19.845648 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:19.845364 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 21:04:19.845648 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:19.845429 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/084dc07e-e49b-44e3-95cc-11e11c5037a5-metrics-certs podName:084dc07e-e49b-44e3-95cc-11e11c5037a5 nodeName:}" failed. No retries permitted until 2026-07-06 21:04:23.845410853 +0000 UTC m=+10.363648969 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/084dc07e-e49b-44e3-95cc-11e11c5037a5-metrics-certs") pod "network-metrics-daemon-c795j" (UID: "084dc07e-e49b-44e3-95cc-11e11c5037a5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 21:04:19.845858 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:19.845840 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 21:04:19.845965 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:19.845899 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1dc41f0-1699-4e7b-bebc-15f2494d9d23-original-pull-secret podName:a1dc41f0-1699-4e7b-bebc-15f2494d9d23 nodeName:}" failed. No retries permitted until 2026-07-06 21:04:23.845881681 +0000 UTC m=+10.364119796 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a1dc41f0-1699-4e7b-bebc-15f2494d9d23-original-pull-secret") pod "global-pull-secret-syncer-vhsmf" (UID: "a1dc41f0-1699-4e7b-bebc-15f2494d9d23") : object "kube-system"/"original-pull-secret" not registered Jul 06 21:04:19.946786 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:19.946162 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8drhf\" (UniqueName: \"kubernetes.io/projected/f107cce5-b80b-4c37-9d88-e582acb83168-kube-api-access-8drhf\") pod \"network-check-target-lvgtq\" (UID: \"f107cce5-b80b-4c37-9d88-e582acb83168\") " pod="openshift-network-diagnostics/network-check-target-lvgtq" Jul 06 21:04:19.946786 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:19.946346 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 21:04:19.946786 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:19.946369 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 21:04:19.946786 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:19.946382 2563 projected.go:196] Error preparing data for projected volume kube-api-access-8drhf for pod openshift-network-diagnostics/network-check-target-lvgtq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 21:04:19.946786 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:19.946447 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f107cce5-b80b-4c37-9d88-e582acb83168-kube-api-access-8drhf podName:f107cce5-b80b-4c37-9d88-e582acb83168 nodeName:}" failed. No retries permitted until 2026-07-06 21:04:23.946428641 +0000 UTC m=+10.464666773 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8drhf" (UniqueName: "kubernetes.io/projected/f107cce5-b80b-4c37-9d88-e582acb83168-kube-api-access-8drhf") pod "network-check-target-lvgtq" (UID: "f107cce5-b80b-4c37-9d88-e582acb83168") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 21:04:20.030134 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:20.030084 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhsmf" Jul 06 21:04:20.030306 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:20.030217 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhsmf" podUID="a1dc41f0-1699-4e7b-bebc-15f2494d9d23" Jul 06 21:04:20.030572 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:20.030545 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvgtq" Jul 06 21:04:20.030695 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:20.030664 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvgtq" podUID="f107cce5-b80b-4c37-9d88-e582acb83168" Jul 06 21:04:20.030766 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:20.030701 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c795j" Jul 06 21:04:20.030818 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:20.030788 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c795j" podUID="084dc07e-e49b-44e3-95cc-11e11c5037a5" Jul 06 21:04:22.029505 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:22.029467 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c795j" Jul 06 21:04:22.029505 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:22.029501 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhsmf" Jul 06 21:04:22.030035 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:22.029467 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvgtq" Jul 06 21:04:22.030035 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:22.029616 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c795j" podUID="084dc07e-e49b-44e3-95cc-11e11c5037a5" Jul 06 21:04:22.030035 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:22.029717 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvgtq" podUID="f107cce5-b80b-4c37-9d88-e582acb83168" Jul 06 21:04:22.030035 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:22.029790 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhsmf" podUID="a1dc41f0-1699-4e7b-bebc-15f2494d9d23" Jul 06 21:04:23.877176 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:23.877033 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1dc41f0-1699-4e7b-bebc-15f2494d9d23-original-pull-secret\") pod \"global-pull-secret-syncer-vhsmf\" (UID: \"a1dc41f0-1699-4e7b-bebc-15f2494d9d23\") " pod="kube-system/global-pull-secret-syncer-vhsmf" Jul 06 21:04:23.877176 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:23.877104 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/084dc07e-e49b-44e3-95cc-11e11c5037a5-metrics-certs\") pod \"network-metrics-daemon-c795j\" (UID: \"084dc07e-e49b-44e3-95cc-11e11c5037a5\") " pod="openshift-multus/network-metrics-daemon-c795j" Jul 06 21:04:23.877176 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:23.877164 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 21:04:23.877849 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:23.877224 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1dc41f0-1699-4e7b-bebc-15f2494d9d23-original-pull-secret podName:a1dc41f0-1699-4e7b-bebc-15f2494d9d23 nodeName:}" failed. No retries permitted until 2026-07-06 21:04:31.877208045 +0000 UTC m=+18.395446160 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a1dc41f0-1699-4e7b-bebc-15f2494d9d23-original-pull-secret") pod "global-pull-secret-syncer-vhsmf" (UID: "a1dc41f0-1699-4e7b-bebc-15f2494d9d23") : object "kube-system"/"original-pull-secret" not registered Jul 06 21:04:23.877849 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:23.877257 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 21:04:23.877849 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:23.877337 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/084dc07e-e49b-44e3-95cc-11e11c5037a5-metrics-certs podName:084dc07e-e49b-44e3-95cc-11e11c5037a5 nodeName:}" failed. No retries permitted until 2026-07-06 21:04:31.877302399 +0000 UTC m=+18.395540513 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/084dc07e-e49b-44e3-95cc-11e11c5037a5-metrics-certs") pod "network-metrics-daemon-c795j" (UID: "084dc07e-e49b-44e3-95cc-11e11c5037a5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 21:04:23.977714 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:23.977611 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8drhf\" (UniqueName: \"kubernetes.io/projected/f107cce5-b80b-4c37-9d88-e582acb83168-kube-api-access-8drhf\") pod \"network-check-target-lvgtq\" (UID: \"f107cce5-b80b-4c37-9d88-e582acb83168\") " pod="openshift-network-diagnostics/network-check-target-lvgtq" Jul 06 21:04:23.977889 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:23.977746 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 21:04:23.977889 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:23.977769 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 21:04:23.977889 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:23.977781 2563 projected.go:196] Error preparing data for projected volume kube-api-access-8drhf for pod openshift-network-diagnostics/network-check-target-lvgtq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 21:04:23.977889 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:23.977832 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f107cce5-b80b-4c37-9d88-e582acb83168-kube-api-access-8drhf podName:f107cce5-b80b-4c37-9d88-e582acb83168 nodeName:}" failed. No retries permitted until 2026-07-06 21:04:31.977817243 +0000 UTC m=+18.496055366 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8drhf" (UniqueName: "kubernetes.io/projected/f107cce5-b80b-4c37-9d88-e582acb83168-kube-api-access-8drhf") pod "network-check-target-lvgtq" (UID: "f107cce5-b80b-4c37-9d88-e582acb83168") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 21:04:24.030542 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:24.029794 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvgtq" Jul 06 21:04:24.030542 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:24.029902 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvgtq" podUID="f107cce5-b80b-4c37-9d88-e582acb83168" Jul 06 21:04:24.030542 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:24.030263 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c795j" Jul 06 21:04:24.030542 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:24.030380 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c795j" podUID="084dc07e-e49b-44e3-95cc-11e11c5037a5" Jul 06 21:04:24.030542 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:24.030438 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhsmf" Jul 06 21:04:24.030542 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:24.030505 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhsmf" podUID="a1dc41f0-1699-4e7b-bebc-15f2494d9d23" Jul 06 21:04:26.030006 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:26.029745 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhsmf" Jul 06 21:04:26.030494 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:26.030108 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhsmf" podUID="a1dc41f0-1699-4e7b-bebc-15f2494d9d23" Jul 06 21:04:26.030494 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:26.029830 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c795j" Jul 06 21:04:26.030494 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:26.030216 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c795j" podUID="084dc07e-e49b-44e3-95cc-11e11c5037a5" Jul 06 21:04:26.030494 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:26.029817 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvgtq" Jul 06 21:04:26.030494 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:26.030288 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvgtq" podUID="f107cce5-b80b-4c37-9d88-e582acb83168" Jul 06 21:04:28.029601 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:28.029556 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvgtq" Jul 06 21:04:28.029601 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:28.029597 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c795j" Jul 06 21:04:28.030120 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:28.029712 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvgtq" podUID="f107cce5-b80b-4c37-9d88-e582acb83168" Jul 06 21:04:28.030120 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:28.029729 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhsmf" Jul 06 21:04:28.030120 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:28.029867 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c795j" podUID="084dc07e-e49b-44e3-95cc-11e11c5037a5" Jul 06 21:04:28.030120 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:28.029938 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhsmf" podUID="a1dc41f0-1699-4e7b-bebc-15f2494d9d23" Jul 06 21:04:30.029744 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:30.029709 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c795j" Jul 06 21:04:30.030169 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:30.029709 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhsmf" Jul 06 21:04:30.030169 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:30.029848 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c795j" podUID="084dc07e-e49b-44e3-95cc-11e11c5037a5" Jul 06 21:04:30.030169 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:30.029937 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhsmf" podUID="a1dc41f0-1699-4e7b-bebc-15f2494d9d23" Jul 06 21:04:30.030169 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:30.029726 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvgtq" Jul 06 21:04:30.030169 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:30.030067 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvgtq" podUID="f107cce5-b80b-4c37-9d88-e582acb83168" Jul 06 21:04:31.936602 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:31.936527 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1dc41f0-1699-4e7b-bebc-15f2494d9d23-original-pull-secret\") pod \"global-pull-secret-syncer-vhsmf\" (UID: \"a1dc41f0-1699-4e7b-bebc-15f2494d9d23\") " pod="kube-system/global-pull-secret-syncer-vhsmf" Jul 06 21:04:31.936602 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:31.936570 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/084dc07e-e49b-44e3-95cc-11e11c5037a5-metrics-certs\") pod \"network-metrics-daemon-c795j\" (UID: \"084dc07e-e49b-44e3-95cc-11e11c5037a5\") " pod="openshift-multus/network-metrics-daemon-c795j" Jul 06 21:04:31.937062 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:31.936683 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 21:04:31.937062 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:31.936698 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 21:04:31.937062 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:31.936740 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/084dc07e-e49b-44e3-95cc-11e11c5037a5-metrics-certs podName:084dc07e-e49b-44e3-95cc-11e11c5037a5 nodeName:}" failed. No retries permitted until 2026-07-06 21:04:47.936727256 +0000 UTC m=+34.454965367 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/084dc07e-e49b-44e3-95cc-11e11c5037a5-metrics-certs") pod "network-metrics-daemon-c795j" (UID: "084dc07e-e49b-44e3-95cc-11e11c5037a5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 21:04:31.937062 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:31.936773 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1dc41f0-1699-4e7b-bebc-15f2494d9d23-original-pull-secret podName:a1dc41f0-1699-4e7b-bebc-15f2494d9d23 nodeName:}" failed. No retries permitted until 2026-07-06 21:04:47.936754512 +0000 UTC m=+34.454992640 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a1dc41f0-1699-4e7b-bebc-15f2494d9d23-original-pull-secret") pod "global-pull-secret-syncer-vhsmf" (UID: "a1dc41f0-1699-4e7b-bebc-15f2494d9d23") : object "kube-system"/"original-pull-secret" not registered Jul 06 21:04:32.029896 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:32.029861 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvgtq" Jul 06 21:04:32.030052 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:32.029861 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c795j" Jul 06 21:04:32.030052 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:32.029995 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhsmf" Jul 06 21:04:32.030052 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:32.029993 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvgtq" podUID="f107cce5-b80b-4c37-9d88-e582acb83168" Jul 06 21:04:32.030221 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:32.030086 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c795j" podUID="084dc07e-e49b-44e3-95cc-11e11c5037a5" Jul 06 21:04:32.030221 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:32.030164 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhsmf" podUID="a1dc41f0-1699-4e7b-bebc-15f2494d9d23" Jul 06 21:04:32.037754 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:32.037728 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8drhf\" (UniqueName: \"kubernetes.io/projected/f107cce5-b80b-4c37-9d88-e582acb83168-kube-api-access-8drhf\") pod \"network-check-target-lvgtq\" (UID: \"f107cce5-b80b-4c37-9d88-e582acb83168\") " pod="openshift-network-diagnostics/network-check-target-lvgtq" Jul 06 21:04:32.037921 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:32.037895 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 21:04:32.037921 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:32.037924 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 21:04:32.038066 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:32.037935 2563 projected.go:196] Error preparing data for projected volume kube-api-access-8drhf for pod openshift-network-diagnostics/network-check-target-lvgtq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 21:04:32.038066 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:32.037986 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f107cce5-b80b-4c37-9d88-e582acb83168-kube-api-access-8drhf podName:f107cce5-b80b-4c37-9d88-e582acb83168 nodeName:}" failed. No retries permitted until 2026-07-06 21:04:48.037969256 +0000 UTC m=+34.556207367 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8drhf" (UniqueName: "kubernetes.io/projected/f107cce5-b80b-4c37-9d88-e582acb83168-kube-api-access-8drhf") pod "network-check-target-lvgtq" (UID: "f107cce5-b80b-4c37-9d88-e582acb83168") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 21:04:34.030484 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:34.030408 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvgtq" Jul 06 21:04:34.030943 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:34.030513 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvgtq" podUID="f107cce5-b80b-4c37-9d88-e582acb83168" Jul 06 21:04:34.030943 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:34.030710 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c795j" Jul 06 21:04:34.030943 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:34.030796 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c795j" podUID="084dc07e-e49b-44e3-95cc-11e11c5037a5" Jul 06 21:04:34.030943 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:34.030831 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhsmf" Jul 06 21:04:34.030943 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:34.030882 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhsmf" podUID="a1dc41f0-1699-4e7b-bebc-15f2494d9d23" Jul 06 21:04:36.032207 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:36.032175 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhsmf" Jul 06 21:04:36.032646 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:36.032299 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c795j" Jul 06 21:04:36.032646 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:36.032325 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvgtq" Jul 06 21:04:36.032646 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:36.032306 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhsmf" podUID="a1dc41f0-1699-4e7b-bebc-15f2494d9d23" Jul 06 21:04:36.032646 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:36.032440 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c795j" podUID="084dc07e-e49b-44e3-95cc-11e11c5037a5" Jul 06 21:04:36.032646 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:36.032529 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvgtq" podUID="f107cce5-b80b-4c37-9d88-e582acb83168" Jul 06 21:04:37.199449 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:37.199177 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-24957" event={"ID":"f38e9c39-8bb8-44e7-b69c-1da913bec44a","Type":"ContainerStarted","Data":"50ce98f8a6db1cf2b6b4352c1b9ad5ef580ba55d687079c280d0b439f061a9d0"} Jul 06 21:04:37.209736 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:37.209705 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-182.ec2.internal" event={"ID":"0d48b88b816a78be0b1d9723b38c9f11","Type":"ContainerStarted","Data":"ccf4d651505de4f41b790124d4671fc8f6e7822d0683b3dd29302cec33203220"} Jul 06 21:04:37.211276 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:37.211243 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lvxjl" event={"ID":"1cfb7af5-011a-4522-96bf-00eaf75fe18e","Type":"ContainerStarted","Data":"fddbb3ed49638521f98c7fd2ca8ef5b7ae27d0236ae4e597774b89ed30bf7fda"} Jul 06 21:04:37.220557 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:37.220511 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-24957" podStartSLOduration=3.250871113 podStartE2EDuration="23.220497266s" totalImagesPullingTime="19.969626153s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:04:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:04:37.22020012 +0000 UTC m=+23.738438294" watchObservedRunningTime="2026-07-06 21:04:37.220497266 +0000 UTC m=+23.738735398" Jul 06 21:04:37.239813 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:37.239764 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lvxjl" podStartSLOduration=3.516969145 podStartE2EDuration="23.23974841s" totalImagesPullingTime="19.722779265s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:04:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:04:37.239495567 +0000 UTC m=+23.757733721" watchObservedRunningTime="2026-07-06 21:04:37.23974841 +0000 UTC m=+23.757986542" Jul 06 21:04:37.254795 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:37.254255 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-182.ec2.internal" podStartSLOduration=22.254233472 podStartE2EDuration="22.254233472s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:04:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:04:37.253811827 +0000 UTC m=+23.772049992" watchObservedRunningTime="2026-07-06 21:04:37.254233472 +0000 UTC m=+23.772471605" Jul 06 21:04:38.032458 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:38.032243 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhsmf" Jul 06 21:04:38.032677 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:38.032303 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvgtq" Jul 06 21:04:38.032677 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:38.032573 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhsmf" podUID="a1dc41f0-1699-4e7b-bebc-15f2494d9d23" Jul 06 21:04:38.032677 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:38.032303 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c795j" Jul 06 21:04:38.032677 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:38.032627 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvgtq" podUID="f107cce5-b80b-4c37-9d88-e582acb83168" Jul 06 21:04:38.032830 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:38.032695 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c795j" podUID="084dc07e-e49b-44e3-95cc-11e11c5037a5" Jul 06 21:04:38.215423 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:38.215328 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zhhvw" event={"ID":"34abb9cb-886c-4133-b204-c5c02d6dbdf6","Type":"ContainerStarted","Data":"3089fd79d8856067c4758968923431a46f8b4b4dd1be76646494bbd13cd743ca"} Jul 06 21:04:38.217039 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:38.217001 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-28sv5" event={"ID":"a7028afb-6989-4fe8-a9a6-1230b13b505e","Type":"ContainerStarted","Data":"d4116bf471ca438a19a9eb8615e6f2b51c8e065604aac87f59b65d87e6424f21"} Jul 06 21:04:38.218751 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:38.218724 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xz26" event={"ID":"d1f73fe4-61a3-46b0-9221-4c49b9a74186","Type":"ContainerStarted","Data":"d0c6fc71973a3fafbaf42fb67ffb8c4da67aed742f577cbf8ef00a1f6d0b78aa"} Jul 06 21:04:38.220376 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:38.220353 2563 generic.go:356] "Generic (PLEG): container finished" podID="c7d7585c17bb1cc23159e5018e86b590" containerID="2a34a48af0e8d97b0b16fb92babc7605c48980a69a6194327910f9b3a0bc0a59" exitCode=0 Jul 06 21:04:38.220511 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:38.220442 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-182.ec2.internal" event={"ID":"c7d7585c17bb1cc23159e5018e86b590","Type":"ContainerDied","Data":"2a34a48af0e8d97b0b16fb92babc7605c48980a69a6194327910f9b3a0bc0a59"} Jul 06 21:04:38.222128 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:38.222106 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-x7g5w" event={"ID":"a58f0fcd-7bf3-4366-b3b2-622f57f9253b","Type":"ContainerStarted","Data":"022a8b8ba7c08a001449baed08ebd1fbb880dd10f518501e0e5bc0052d418592"} Jul 06 21:04:38.223838 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:38.223815 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hnqfz" event={"ID":"6795ede2-22ae-4bd6-932a-f1b7ff2a54ed","Type":"ContainerStarted","Data":"75d2cee86e5652cc966fbc32d20c77e1b679d000063aa05d50605529f78d8bf7"} Jul 06 21:04:38.225373 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:38.225349 2563 generic.go:356] "Generic (PLEG): container finished" podID="2d9510b7-6982-4ead-a75a-e5816ef5b9ab" containerID="c71c4e5b44f26ae13bd8b4d3debb43e1ec13cd5e59749f33f5cd2d6d34c86574" exitCode=0 Jul 06 21:04:38.225476 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:38.225426 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p2h5x" event={"ID":"2d9510b7-6982-4ead-a75a-e5816ef5b9ab","Type":"ContainerDied","Data":"c71c4e5b44f26ae13bd8b4d3debb43e1ec13cd5e59749f33f5cd2d6d34c86574"} Jul 06 21:04:38.228608 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:38.228577 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nsmng_67ff5eff-b2cf-45c9-ab38-9650657413b9/ovn-acl-logging/0.log" Jul 06 21:04:38.228928 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:38.228904 2563 generic.go:356] "Generic (PLEG): container finished" podID="67ff5eff-b2cf-45c9-ab38-9650657413b9" containerID="90a96caa1ca090623e816d9b045e116796dbabc80e19ade59d8af596a9106268" exitCode=1 Jul 06 21:04:38.229035 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:38.229007 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" event={"ID":"67ff5eff-b2cf-45c9-ab38-9650657413b9","Type":"ContainerStarted","Data":"b3d269e88b1a56bbc25c43f97a15d7caa339bbf42c1071709f331652014b32d5"} Jul 06 21:04:38.229092 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:38.229078 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" event={"ID":"67ff5eff-b2cf-45c9-ab38-9650657413b9","Type":"ContainerStarted","Data":"e51f00814ca7329872f32dc621e2ca7ff0967c9e3013989d72e6d95195706ec6"} Jul 06 21:04:38.229160 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:38.229134 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" event={"ID":"67ff5eff-b2cf-45c9-ab38-9650657413b9","Type":"ContainerStarted","Data":"287ace70419a71d9df60768a0a6f21aed600a4afda3d7508c13e8a8ea976e14d"} Jul 06 21:04:38.229206 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:38.229181 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" event={"ID":"67ff5eff-b2cf-45c9-ab38-9650657413b9","Type":"ContainerStarted","Data":"54b55010a34444c23b8b8591920f6f8ed7676f04b5ded6de10b835a064fc913d"} Jul 06 21:04:38.229296 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:38.229274 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" event={"ID":"67ff5eff-b2cf-45c9-ab38-9650657413b9","Type":"ContainerDied","Data":"90a96caa1ca090623e816d9b045e116796dbabc80e19ade59d8af596a9106268"} Jul 06 21:04:38.229421 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:38.229349 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" event={"ID":"67ff5eff-b2cf-45c9-ab38-9650657413b9","Type":"ContainerStarted","Data":"9ba2d3041571eceef0c9b602f08293cc65c13f0fd69f545f7b3e92f86879c6b8"} Jul 06 21:04:38.229588 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:38.229531 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-zhhvw" podStartSLOduration=4.515896022 podStartE2EDuration="24.229518096s" totalImagesPullingTime="19.713622074s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:04:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:04:38.229409022 +0000 UTC m=+24.747647181" watchObservedRunningTime="2026-07-06 21:04:38.229518096 +0000 UTC m=+24.747756230" Jul 06 21:04:38.243078 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:38.243035 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-28sv5" podStartSLOduration=4.525372084 podStartE2EDuration="24.243022282s" totalImagesPullingTime="19.717650198s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:04:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:04:38.242839566 +0000 UTC m=+24.761077693" watchObservedRunningTime="2026-07-06 21:04:38.243022282 +0000 UTC m=+24.761260414" Jul 06 21:04:38.301790 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:38.301739 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hnqfz" podStartSLOduration=4.59774138 podStartE2EDuration="24.3017184s" totalImagesPullingTime="19.70397702s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:04:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:04:38.301142607 +0000 UTC m=+24.819380742" watchObservedRunningTime="2026-07-06 21:04:38.3017184 +0000 UTC m=+24.819956533" Jul 06 21:04:38.314941 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:38.314891 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-x7g5w" podStartSLOduration=4.617150764 podStartE2EDuration="24.314876008s" totalImagesPullingTime="19.697725244s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:04:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:04:38.314576003 +0000 UTC m=+24.832814169" watchObservedRunningTime="2026-07-06 21:04:38.314876008 +0000 UTC m=+24.833114139" Jul 06 21:04:38.988092 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:38.988067 2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 21:04:38.994250 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:38.994156 2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T21:04:38.98808691Z","UUID":"8966feb3-86ae-4989-a7b1-adde94c0f57c","Handler":null,"Name":"","Endpoint":""} Jul 06 21:04:38.995590 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:38.995574 2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 21:04:38.995673 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:38.995612 2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 21:04:39.233708 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:39.233395 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xz26" event={"ID":"d1f73fe4-61a3-46b0-9221-4c49b9a74186","Type":"ContainerStarted","Data":"d276e1ec7518f125ecfcdd5cf00a27f1df0dd79cac405701f5341512de18b2c2"} Jul 06 21:04:39.235719 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:39.235693 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-182.ec2.internal" event={"ID":"c7d7585c17bb1cc23159e5018e86b590","Type":"ContainerStarted","Data":"363965a5e9ddc387d97aa8c117acdffb88121fa1c2dfd4482d7f42a80af425e5"} Jul 06 21:04:40.029778 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:40.029744 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhsmf" Jul 06 21:04:40.029778 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:40.029765 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c795j" Jul 06 21:04:40.030041 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:40.029753 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvgtq" Jul 06 21:04:40.030041 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:40.029875 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhsmf" podUID="a1dc41f0-1699-4e7b-bebc-15f2494d9d23" Jul 06 21:04:40.030041 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:40.029945 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvgtq" podUID="f107cce5-b80b-4c37-9d88-e582acb83168" Jul 06 21:04:40.030197 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:40.030046 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c795j" podUID="084dc07e-e49b-44e3-95cc-11e11c5037a5" Jul 06 21:04:41.243297 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:41.243268 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nsmng_67ff5eff-b2cf-45c9-ab38-9650657413b9/ovn-acl-logging/0.log" Jul 06 21:04:41.243921 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:41.243632 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" event={"ID":"67ff5eff-b2cf-45c9-ab38-9650657413b9","Type":"ContainerStarted","Data":"2b3f2a7bad107edb884db719937dac47187677cb8fd791346d18278e97cae079"} Jul 06 21:04:41.245593 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:41.245567 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xz26" event={"ID":"d1f73fe4-61a3-46b0-9221-4c49b9a74186","Type":"ContainerStarted","Data":"2946775cc4246ac7f670e2d6b7c05b5ab6c225fa789d973a0fe4e37850d0a312"} Jul 06 21:04:41.263269 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:41.263226 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xz26" podStartSLOduration=4.620201359 podStartE2EDuration="27.263211276s" totalImagesPullingTime="22.643009917s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:04:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:04:41.263184915 +0000 UTC m=+27.781423051" watchObservedRunningTime="2026-07-06 21:04:41.263211276 +0000 UTC m=+27.781449390" Jul 06 21:04:41.263448 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:41.263429 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-182.ec2.internal" podStartSLOduration=26.263422336 podStartE2EDuration="26.263422336s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:04:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:04:39.250778609 +0000 UTC m=+25.769016742" watchObservedRunningTime="2026-07-06 21:04:41.263422336 +0000 UTC m=+27.781660467" Jul 06 21:04:42.029149 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:42.029120 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvgtq" Jul 06 21:04:42.029355 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:42.029122 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c795j" Jul 06 21:04:42.029355 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:42.029222 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvgtq" podUID="f107cce5-b80b-4c37-9d88-e582acb83168" Jul 06 21:04:42.029355 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:42.029264 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhsmf" Jul 06 21:04:42.029530 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:42.029367 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c795j" podUID="084dc07e-e49b-44e3-95cc-11e11c5037a5" Jul 06 21:04:42.029530 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:42.029427 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhsmf" podUID="a1dc41f0-1699-4e7b-bebc-15f2494d9d23" Jul 06 21:04:43.089217 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:43.089028 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-x7g5w" Jul 06 21:04:43.089903 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:43.089650 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-x7g5w" Jul 06 21:04:43.254191 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:43.254164 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nsmng_67ff5eff-b2cf-45c9-ab38-9650657413b9/ovn-acl-logging/0.log" Jul 06 21:04:43.254778 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:43.254669 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" event={"ID":"67ff5eff-b2cf-45c9-ab38-9650657413b9","Type":"ContainerStarted","Data":"f3b9b7e4dd291b0d1b2e3f6e9b8025e558d665a85fc805ee70f626e5413c51c2"} Jul 06 21:04:43.255221 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:43.255201 2563 scope.go:117] "RemoveContainer" containerID="90a96caa1ca090623e816d9b045e116796dbabc80e19ade59d8af596a9106268" Jul 06 21:04:44.030011 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:44.029968 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhsmf" Jul 06 21:04:44.030209 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:44.030074 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvgtq" Jul 06 21:04:44.030209 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:44.030146 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvgtq" podUID="f107cce5-b80b-4c37-9d88-e582acb83168" Jul 06 21:04:44.030209 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:44.030171 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhsmf" podUID="a1dc41f0-1699-4e7b-bebc-15f2494d9d23" Jul 06 21:04:44.030209 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:44.030197 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c795j" Jul 06 21:04:44.030579 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:44.030306 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c795j" podUID="084dc07e-e49b-44e3-95cc-11e11c5037a5" Jul 06 21:04:44.363614 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:44.363513 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vhsmf"] Jul 06 21:04:44.364118 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:44.363651 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhsmf" Jul 06 21:04:44.364118 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:44.363766 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhsmf" podUID="a1dc41f0-1699-4e7b-bebc-15f2494d9d23" Jul 06 21:04:44.367146 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:44.367122 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lvgtq"] Jul 06 21:04:44.367270 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:44.367223 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvgtq" Jul 06 21:04:44.367355 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:44.367336 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvgtq" podUID="f107cce5-b80b-4c37-9d88-e582acb83168" Jul 06 21:04:44.370141 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:44.370108 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-c795j"] Jul 06 21:04:44.370234 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:44.370219 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c795j" Jul 06 21:04:44.370361 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:44.370340 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c795j" podUID="084dc07e-e49b-44e3-95cc-11e11c5037a5" Jul 06 21:04:44.670389 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:44.670356 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-x7g5w" Jul 06 21:04:44.670531 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:44.670505 2563 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 06 21:04:44.671001 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:44.670979 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-x7g5w" Jul 06 21:04:45.260869 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:45.260834 2563 generic.go:356] "Generic (PLEG): container finished" podID="2d9510b7-6982-4ead-a75a-e5816ef5b9ab" containerID="d15bd1f631f72d92c6bd18a81c8213ea15089b8b29c3fa78beeda351c3d302e1" exitCode=0 Jul 06 21:04:45.261038 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:45.260922 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p2h5x" event={"ID":"2d9510b7-6982-4ead-a75a-e5816ef5b9ab","Type":"ContainerDied","Data":"d15bd1f631f72d92c6bd18a81c8213ea15089b8b29c3fa78beeda351c3d302e1"} Jul 06 21:04:45.264720 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:45.264702 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nsmng_67ff5eff-b2cf-45c9-ab38-9650657413b9/ovn-acl-logging/0.log" Jul 06 21:04:45.265135 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:45.265111 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" event={"ID":"67ff5eff-b2cf-45c9-ab38-9650657413b9","Type":"ContainerStarted","Data":"99fc62d4832614e1175c076837cb6639d778e85b6feca73cbe7db8783363e678"} Jul 06 21:04:45.265342 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:45.265275 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:45.265478 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:45.265378 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:45.265478 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:45.265424 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:45.280665 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:45.280472 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:45.280768 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:45.280759 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:04:45.311982 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:45.311933 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" podStartSLOduration=10.625207313 podStartE2EDuration="31.311920303s" totalImagesPullingTime="20.68671299s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:04:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:04:45.310619542 +0000 UTC m=+31.828857670" watchObservedRunningTime="2026-07-06 21:04:45.311920303 +0000 UTC m=+31.830158435" Jul 06 21:04:46.029484 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:46.029451 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvgtq" Jul 06 21:04:46.029927 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:46.029451 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c795j" Jul 06 21:04:46.029927 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:46.029451 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhsmf" Jul 06 21:04:46.029927 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:46.029618 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvgtq" podUID="f107cce5-b80b-4c37-9d88-e582acb83168" Jul 06 21:04:46.029927 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:46.029716 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhsmf" podUID="a1dc41f0-1699-4e7b-bebc-15f2494d9d23" Jul 06 21:04:46.029927 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:46.029794 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c795j" podUID="084dc07e-e49b-44e3-95cc-11e11c5037a5" Jul 06 21:04:47.271547 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:47.271465 2563 generic.go:356] "Generic (PLEG): container finished" podID="2d9510b7-6982-4ead-a75a-e5816ef5b9ab" containerID="980058b398657d58ca665035ad0112a26ab70e56d229e36cbafd54c979cbaa40" exitCode=0 Jul 06 21:04:47.272072 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:47.271554 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p2h5x" event={"ID":"2d9510b7-6982-4ead-a75a-e5816ef5b9ab","Type":"ContainerDied","Data":"980058b398657d58ca665035ad0112a26ab70e56d229e36cbafd54c979cbaa40"} Jul 06 21:04:47.282936 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:47.282898 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" podUID="67ff5eff-b2cf-45c9-ab38-9650657413b9" containerName="ovnkube-controller" probeResult="failure" output="" Jul 06 21:04:47.945938 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:47.945905 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1dc41f0-1699-4e7b-bebc-15f2494d9d23-original-pull-secret\") pod \"global-pull-secret-syncer-vhsmf\" (UID: \"a1dc41f0-1699-4e7b-bebc-15f2494d9d23\") " pod="kube-system/global-pull-secret-syncer-vhsmf" Jul 06 21:04:47.946081 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:47.945945 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/084dc07e-e49b-44e3-95cc-11e11c5037a5-metrics-certs\") pod \"network-metrics-daemon-c795j\" (UID: \"084dc07e-e49b-44e3-95cc-11e11c5037a5\") " pod="openshift-multus/network-metrics-daemon-c795j" Jul 06 21:04:47.946081 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:47.946050 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 21:04:47.946081 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:47.946077 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 21:04:47.946187 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:47.946112 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/084dc07e-e49b-44e3-95cc-11e11c5037a5-metrics-certs podName:084dc07e-e49b-44e3-95cc-11e11c5037a5 nodeName:}" failed. No retries permitted until 2026-07-06 21:05:19.946097851 +0000 UTC m=+66.464335964 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/084dc07e-e49b-44e3-95cc-11e11c5037a5-metrics-certs") pod "network-metrics-daemon-c795j" (UID: "084dc07e-e49b-44e3-95cc-11e11c5037a5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 21:04:47.946187 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:47.946127 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1dc41f0-1699-4e7b-bebc-15f2494d9d23-original-pull-secret podName:a1dc41f0-1699-4e7b-bebc-15f2494d9d23 nodeName:}" failed. No retries permitted until 2026-07-06 21:05:19.946119559 +0000 UTC m=+66.464357668 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a1dc41f0-1699-4e7b-bebc-15f2494d9d23-original-pull-secret") pod "global-pull-secret-syncer-vhsmf" (UID: "a1dc41f0-1699-4e7b-bebc-15f2494d9d23") : object "kube-system"/"original-pull-secret" not registered Jul 06 21:04:48.034367 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:48.034286 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvgtq" Jul 06 21:04:48.034520 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:48.034391 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhsmf" Jul 06 21:04:48.034520 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:48.034400 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvgtq" podUID="f107cce5-b80b-4c37-9d88-e582acb83168" Jul 06 21:04:48.034520 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:48.034416 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c795j" Jul 06 21:04:48.034520 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:48.034481 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhsmf" podUID="a1dc41f0-1699-4e7b-bebc-15f2494d9d23" Jul 06 21:04:48.034652 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:48.034542 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c795j" podUID="084dc07e-e49b-44e3-95cc-11e11c5037a5" Jul 06 21:04:48.046801 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:48.046777 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8drhf\" (UniqueName: \"kubernetes.io/projected/f107cce5-b80b-4c37-9d88-e582acb83168-kube-api-access-8drhf\") pod \"network-check-target-lvgtq\" (UID: \"f107cce5-b80b-4c37-9d88-e582acb83168\") " pod="openshift-network-diagnostics/network-check-target-lvgtq" Jul 06 21:04:48.046907 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:48.046892 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 21:04:48.046907 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:48.046907 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 21:04:48.046972 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:48.046915 2563 projected.go:196] Error preparing data for projected volume kube-api-access-8drhf for pod openshift-network-diagnostics/network-check-target-lvgtq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 21:04:48.046972 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:48.046961 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f107cce5-b80b-4c37-9d88-e582acb83168-kube-api-access-8drhf podName:f107cce5-b80b-4c37-9d88-e582acb83168 nodeName:}" failed. No retries permitted until 2026-07-06 21:05:20.046944606 +0000 UTC m=+66.565182730 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8drhf" (UniqueName: "kubernetes.io/projected/f107cce5-b80b-4c37-9d88-e582acb83168-kube-api-access-8drhf") pod "network-check-target-lvgtq" (UID: "f107cce5-b80b-4c37-9d88-e582acb83168") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 21:04:48.275821 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:48.275787 2563 generic.go:356] "Generic (PLEG): container finished" podID="2d9510b7-6982-4ead-a75a-e5816ef5b9ab" containerID="42ce367e0dd3942c661f0f8d80633a2d26aa270830e229e68f45bc29d39a02cb" exitCode=0 Jul 06 21:04:48.276432 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:48.275839 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p2h5x" event={"ID":"2d9510b7-6982-4ead-a75a-e5816ef5b9ab","Type":"ContainerDied","Data":"42ce367e0dd3942c661f0f8d80633a2d26aa270830e229e68f45bc29d39a02cb"} Jul 06 21:04:50.029571 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.029540 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvgtq" Jul 06 21:04:50.030012 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.029594 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhsmf" Jul 06 21:04:50.030012 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.029540 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c795j" Jul 06 21:04:50.030012 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:50.029659 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lvgtq" podUID="f107cce5-b80b-4c37-9d88-e582acb83168" Jul 06 21:04:50.030012 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:50.029748 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c795j" podUID="084dc07e-e49b-44e3-95cc-11e11c5037a5" Jul 06 21:04:50.030012 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:50.029834 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhsmf" podUID="a1dc41f0-1699-4e7b-bebc-15f2494d9d23" Jul 06 21:04:50.299885 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.299800 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-182.ec2.internal" event="NodeReady" Jul 06 21:04:50.300032 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.299935 2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 21:04:50.334323 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.334279 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-f29qt"] Jul 06 21:04:50.338366 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.338345 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-65d484654d-d45tf"] Jul 06 21:04:50.338507 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.338489 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-f29qt" Jul 06 21:04:50.341518 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.341490 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-nbkdt\"" Jul 06 21:04:50.341818 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.341786 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 06 21:04:50.341931 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.341796 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 06 21:04:50.342221 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.342202 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65d484654d-d45tf" Jul 06 21:04:50.344681 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.344660 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 06 21:04:50.344775 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.344743 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 06 21:04:50.344775 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.344755 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-k47bk\"" Jul 06 21:04:50.344775 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.344768 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 06 21:04:50.352351 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.352305 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-f29qt"] Jul 06 21:04:50.355626 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.355605 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65d484654d-d45tf"] Jul 06 21:04:50.357306 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.357284 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 06 21:04:50.361756 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.361734 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-k5tm2"] Jul 06 21:04:50.365619 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.365600 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-pftrl"] Jul 06 21:04:50.365772 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.365745 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-k5tm2" Jul 06 21:04:50.368732 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.368710 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 21:04:50.368955 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.368916 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 21:04:50.368955 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.368917 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 21:04:50.369075 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.369040 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4qcrw\"" Jul 06 21:04:50.369493 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.369467 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pftrl" Jul 06 21:04:50.371967 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.371948 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 21:04:50.372058 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.371979 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gxsch\"" Jul 06 21:04:50.372126 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.371954 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 21:04:50.373498 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.373481 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pftrl"] Jul 06 21:04:50.376400 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.376377 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-k5tm2"] Jul 06 21:04:50.466405 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.466368 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-bound-sa-token\") pod \"image-registry-65d484654d-d45tf\" (UID: \"21e6ad8b-efe9-4faf-a400-e1014c3dfbb5\") " pod="openshift-image-registry/image-registry-65d484654d-d45tf" Jul 06 21:04:50.466553 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.466496 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2rrw\" (UniqueName: \"kubernetes.io/projected/22c46544-3b08-4ad7-8f17-8a1210bf99b4-kube-api-access-j2rrw\") pod \"ingress-canary-k5tm2\" (UID: \"22c46544-3b08-4ad7-8f17-8a1210bf99b4\") " pod="openshift-ingress-canary/ingress-canary-k5tm2" Jul 06 21:04:50.466553 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.466533 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2v4t7\" (UniqueName: \"kubernetes.io/projected/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-kube-api-access-2v4t7\") pod \"image-registry-65d484654d-d45tf\" (UID: \"21e6ad8b-efe9-4faf-a400-e1014c3dfbb5\") " pod="openshift-image-registry/image-registry-65d484654d-d45tf" Jul 06 21:04:50.466661 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.466557 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1867e5c6-1cdc-4302-b705-5c7cd807677b-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-f29qt\" (UID: \"1867e5c6-1cdc-4302-b705-5c7cd807677b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-f29qt" Jul 06 21:04:50.466661 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.466602 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05fbf402-3b73-4ed1-a153-4e3367a41518-metrics-tls\") pod \"dns-default-pftrl\" (UID: \"05fbf402-3b73-4ed1-a153-4e3367a41518\") " pod="openshift-dns/dns-default-pftrl" Jul 06 21:04:50.466743 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.466644 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-image-registry-private-configuration\") pod \"image-registry-65d484654d-d45tf\" (UID: \"21e6ad8b-efe9-4faf-a400-e1014c3dfbb5\") " pod="openshift-image-registry/image-registry-65d484654d-d45tf" Jul 06 21:04:50.466743 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.466698 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-ca-trust-extracted\") pod \"image-registry-65d484654d-d45tf\" (UID: \"21e6ad8b-efe9-4faf-a400-e1014c3dfbb5\") " pod="openshift-image-registry/image-registry-65d484654d-d45tf" Jul 06 21:04:50.466743 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.466723 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-registry-certificates\") pod \"image-registry-65d484654d-d45tf\" (UID: \"21e6ad8b-efe9-4faf-a400-e1014c3dfbb5\") " pod="openshift-image-registry/image-registry-65d484654d-d45tf" Jul 06 21:04:50.466870 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.466748 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-installation-pull-secrets\") pod \"image-registry-65d484654d-d45tf\" (UID: \"21e6ad8b-efe9-4faf-a400-e1014c3dfbb5\") " pod="openshift-image-registry/image-registry-65d484654d-d45tf" Jul 06 21:04:50.466870 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.466771 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/05fbf402-3b73-4ed1-a153-4e3367a41518-config-volume\") pod \"dns-default-pftrl\" (UID: \"05fbf402-3b73-4ed1-a153-4e3367a41518\") " pod="openshift-dns/dns-default-pftrl" Jul 06 21:04:50.466870 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.466825 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05fbf402-3b73-4ed1-a153-4e3367a41518-tmp-dir\") pod \"dns-default-pftrl\" (UID: \"05fbf402-3b73-4ed1-a153-4e3367a41518\") " pod="openshift-dns/dns-default-pftrl" Jul 06 21:04:50.466870 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.466859 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p94kt\" (UniqueName: \"kubernetes.io/projected/05fbf402-3b73-4ed1-a153-4e3367a41518-kube-api-access-p94kt\") pod \"dns-default-pftrl\" (UID: \"05fbf402-3b73-4ed1-a153-4e3367a41518\") " pod="openshift-dns/dns-default-pftrl" Jul 06 21:04:50.467012 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.466895 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1867e5c6-1cdc-4302-b705-5c7cd807677b-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-f29qt\" (UID: \"1867e5c6-1cdc-4302-b705-5c7cd807677b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-f29qt" Jul 06 21:04:50.467012 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.466915 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-trusted-ca\") pod \"image-registry-65d484654d-d45tf\" (UID: \"21e6ad8b-efe9-4faf-a400-e1014c3dfbb5\") " pod="openshift-image-registry/image-registry-65d484654d-d45tf" Jul 06 21:04:50.467012 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.466987 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/22c46544-3b08-4ad7-8f17-8a1210bf99b4-cert\") pod \"ingress-canary-k5tm2\" (UID: \"22c46544-3b08-4ad7-8f17-8a1210bf99b4\") " pod="openshift-ingress-canary/ingress-canary-k5tm2" Jul 06 21:04:50.467133 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.467039 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-registry-tls\") pod \"image-registry-65d484654d-d45tf\" (UID: \"21e6ad8b-efe9-4faf-a400-e1014c3dfbb5\") " pod="openshift-image-registry/image-registry-65d484654d-d45tf" Jul 06 21:04:50.567937 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.567691 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-bound-sa-token\") pod \"image-registry-65d484654d-d45tf\" (UID: \"21e6ad8b-efe9-4faf-a400-e1014c3dfbb5\") " pod="openshift-image-registry/image-registry-65d484654d-d45tf" Jul 06 21:04:50.567937 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.567933 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2rrw\" (UniqueName: \"kubernetes.io/projected/22c46544-3b08-4ad7-8f17-8a1210bf99b4-kube-api-access-j2rrw\") pod \"ingress-canary-k5tm2\" (UID: \"22c46544-3b08-4ad7-8f17-8a1210bf99b4\") " pod="openshift-ingress-canary/ingress-canary-k5tm2" Jul 06 21:04:50.568166 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.567959 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2v4t7\" (UniqueName: \"kubernetes.io/projected/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-kube-api-access-2v4t7\") pod \"image-registry-65d484654d-d45tf\" (UID: \"21e6ad8b-efe9-4faf-a400-e1014c3dfbb5\") " pod="openshift-image-registry/image-registry-65d484654d-d45tf" Jul 06 21:04:50.568166 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.567977 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1867e5c6-1cdc-4302-b705-5c7cd807677b-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-f29qt\" (UID: \"1867e5c6-1cdc-4302-b705-5c7cd807677b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-f29qt" Jul 06 21:04:50.568166 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.567998 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05fbf402-3b73-4ed1-a153-4e3367a41518-metrics-tls\") pod \"dns-default-pftrl\" (UID: \"05fbf402-3b73-4ed1-a153-4e3367a41518\") " pod="openshift-dns/dns-default-pftrl" Jul 06 21:04:50.568166 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.568028 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-image-registry-private-configuration\") pod \"image-registry-65d484654d-d45tf\" (UID: \"21e6ad8b-efe9-4faf-a400-e1014c3dfbb5\") " pod="openshift-image-registry/image-registry-65d484654d-d45tf" Jul 06 21:04:50.568166 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:50.568118 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 21:04:50.568447 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.568174 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-ca-trust-extracted\") pod \"image-registry-65d484654d-d45tf\" (UID: \"21e6ad8b-efe9-4faf-a400-e1014c3dfbb5\") " pod="openshift-image-registry/image-registry-65d484654d-d45tf" Jul 06 21:04:50.568447 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:50.568196 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05fbf402-3b73-4ed1-a153-4e3367a41518-metrics-tls podName:05fbf402-3b73-4ed1-a153-4e3367a41518 nodeName:}" failed. No retries permitted until 2026-07-06 21:04:51.068174441 +0000 UTC m=+37.586412553 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/05fbf402-3b73-4ed1-a153-4e3367a41518-metrics-tls") pod "dns-default-pftrl" (UID: "05fbf402-3b73-4ed1-a153-4e3367a41518") : secret "dns-default-metrics-tls" not found Jul 06 21:04:50.568447 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.568232 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-registry-certificates\") pod \"image-registry-65d484654d-d45tf\" (UID: \"21e6ad8b-efe9-4faf-a400-e1014c3dfbb5\") " pod="openshift-image-registry/image-registry-65d484654d-d45tf" Jul 06 21:04:50.568447 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.568261 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-installation-pull-secrets\") pod \"image-registry-65d484654d-d45tf\" (UID: \"21e6ad8b-efe9-4faf-a400-e1014c3dfbb5\") " pod="openshift-image-registry/image-registry-65d484654d-d45tf" Jul 06 21:04:50.568447 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.568286 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/05fbf402-3b73-4ed1-a153-4e3367a41518-config-volume\") pod \"dns-default-pftrl\" (UID: \"05fbf402-3b73-4ed1-a153-4e3367a41518\") " pod="openshift-dns/dns-default-pftrl" Jul 06 21:04:50.568447 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.568332 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05fbf402-3b73-4ed1-a153-4e3367a41518-tmp-dir\") pod \"dns-default-pftrl\" (UID: \"05fbf402-3b73-4ed1-a153-4e3367a41518\") " pod="openshift-dns/dns-default-pftrl" Jul 06 21:04:50.568447 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.568359 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p94kt\" (UniqueName: \"kubernetes.io/projected/05fbf402-3b73-4ed1-a153-4e3367a41518-kube-api-access-p94kt\") pod \"dns-default-pftrl\" (UID: \"05fbf402-3b73-4ed1-a153-4e3367a41518\") " pod="openshift-dns/dns-default-pftrl" Jul 06 21:04:50.568447 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.568423 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1867e5c6-1cdc-4302-b705-5c7cd807677b-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-f29qt\" (UID: \"1867e5c6-1cdc-4302-b705-5c7cd807677b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-f29qt" Jul 06 21:04:50.568845 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.568453 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-trusted-ca\") pod \"image-registry-65d484654d-d45tf\" (UID: \"21e6ad8b-efe9-4faf-a400-e1014c3dfbb5\") " pod="openshift-image-registry/image-registry-65d484654d-d45tf" Jul 06 21:04:50.568845 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.568487 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/22c46544-3b08-4ad7-8f17-8a1210bf99b4-cert\") pod \"ingress-canary-k5tm2\" (UID: \"22c46544-3b08-4ad7-8f17-8a1210bf99b4\") " pod="openshift-ingress-canary/ingress-canary-k5tm2" Jul 06 21:04:50.568845 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.568514 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-registry-tls\") pod \"image-registry-65d484654d-d45tf\" (UID: \"21e6ad8b-efe9-4faf-a400-e1014c3dfbb5\") " pod="openshift-image-registry/image-registry-65d484654d-d45tf" Jul 06 21:04:50.568845 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.568598 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-ca-trust-extracted\") pod \"image-registry-65d484654d-d45tf\" (UID: \"21e6ad8b-efe9-4faf-a400-e1014c3dfbb5\") " pod="openshift-image-registry/image-registry-65d484654d-d45tf" Jul 06 21:04:50.568845 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.568733 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05fbf402-3b73-4ed1-a153-4e3367a41518-tmp-dir\") pod \"dns-default-pftrl\" (UID: \"05fbf402-3b73-4ed1-a153-4e3367a41518\") " pod="openshift-dns/dns-default-pftrl" Jul 06 21:04:50.569099 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.568849 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1867e5c6-1cdc-4302-b705-5c7cd807677b-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-f29qt\" (UID: \"1867e5c6-1cdc-4302-b705-5c7cd807677b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-f29qt" Jul 06 21:04:50.569099 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:50.568627 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 21:04:50.569099 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:50.568895 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65d484654d-d45tf: secret "image-registry-tls" not found Jul 06 21:04:50.569099 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:50.568701 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 21:04:50.569099 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.568893 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-registry-certificates\") pod \"image-registry-65d484654d-d45tf\" (UID: \"21e6ad8b-efe9-4faf-a400-e1014c3dfbb5\") " pod="openshift-image-registry/image-registry-65d484654d-d45tf" Jul 06 21:04:50.569099 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:50.568958 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-registry-tls podName:21e6ad8b-efe9-4faf-a400-e1014c3dfbb5 nodeName:}" failed. No retries permitted until 2026-07-06 21:04:51.068939355 +0000 UTC m=+37.587177467 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-registry-tls") pod "image-registry-65d484654d-d45tf" (UID: "21e6ad8b-efe9-4faf-a400-e1014c3dfbb5") : secret "image-registry-tls" not found Jul 06 21:04:50.569099 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:50.568977 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1867e5c6-1cdc-4302-b705-5c7cd807677b-networking-console-plugin-cert podName:1867e5c6-1cdc-4302-b705-5c7cd807677b nodeName:}" failed. No retries permitted until 2026-07-06 21:04:51.068966975 +0000 UTC m=+37.587205084 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1867e5c6-1cdc-4302-b705-5c7cd807677b-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-f29qt" (UID: "1867e5c6-1cdc-4302-b705-5c7cd807677b") : secret "networking-console-plugin-cert" not found Jul 06 21:04:50.569469 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.569191 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/05fbf402-3b73-4ed1-a153-4e3367a41518-config-volume\") pod \"dns-default-pftrl\" (UID: \"05fbf402-3b73-4ed1-a153-4e3367a41518\") " pod="openshift-dns/dns-default-pftrl" Jul 06 21:04:50.569575 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.569555 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-trusted-ca\") pod \"image-registry-65d484654d-d45tf\" (UID: \"21e6ad8b-efe9-4faf-a400-e1014c3dfbb5\") " pod="openshift-image-registry/image-registry-65d484654d-d45tf" Jul 06 21:04:50.572362 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.572345 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-image-registry-private-configuration\") pod \"image-registry-65d484654d-d45tf\" (UID: \"21e6ad8b-efe9-4faf-a400-e1014c3dfbb5\") " pod="openshift-image-registry/image-registry-65d484654d-d45tf" Jul 06 21:04:50.572446 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.572429 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-installation-pull-secrets\") pod \"image-registry-65d484654d-d45tf\" (UID: \"21e6ad8b-efe9-4faf-a400-e1014c3dfbb5\") " pod="openshift-image-registry/image-registry-65d484654d-d45tf" Jul 06 21:04:50.572523 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.572510 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/22c46544-3b08-4ad7-8f17-8a1210bf99b4-cert\") pod \"ingress-canary-k5tm2\" (UID: \"22c46544-3b08-4ad7-8f17-8a1210bf99b4\") " pod="openshift-ingress-canary/ingress-canary-k5tm2" Jul 06 21:04:50.579254 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.578990 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2rrw\" (UniqueName: \"kubernetes.io/projected/22c46544-3b08-4ad7-8f17-8a1210bf99b4-kube-api-access-j2rrw\") pod \"ingress-canary-k5tm2\" (UID: \"22c46544-3b08-4ad7-8f17-8a1210bf99b4\") " pod="openshift-ingress-canary/ingress-canary-k5tm2" Jul 06 21:04:50.579254 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.579250 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p94kt\" (UniqueName: \"kubernetes.io/projected/05fbf402-3b73-4ed1-a153-4e3367a41518-kube-api-access-p94kt\") pod \"dns-default-pftrl\" (UID: \"05fbf402-3b73-4ed1-a153-4e3367a41518\") " pod="openshift-dns/dns-default-pftrl" Jul 06 21:04:50.579429 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.579261 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-bound-sa-token\") pod \"image-registry-65d484654d-d45tf\" (UID: \"21e6ad8b-efe9-4faf-a400-e1014c3dfbb5\") " pod="openshift-image-registry/image-registry-65d484654d-d45tf" Jul 06 21:04:50.579497 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.579476 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2v4t7\" (UniqueName: \"kubernetes.io/projected/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-kube-api-access-2v4t7\") pod \"image-registry-65d484654d-d45tf\" (UID: \"21e6ad8b-efe9-4faf-a400-e1014c3dfbb5\") " pod="openshift-image-registry/image-registry-65d484654d-d45tf" Jul 06 21:04:50.677081 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.677043 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-k5tm2" Jul 06 21:04:50.810030 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:50.810000 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-k5tm2"] Jul 06 21:04:50.813823 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:04:50.813784 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22c46544_3b08_4ad7_8f17_8a1210bf99b4.slice/crio-8185d63db12a6b62ad0c0ad48085b4d482cb12ea2528b0beca89496aa1aa3581 WatchSource:0}: Error finding container 8185d63db12a6b62ad0c0ad48085b4d482cb12ea2528b0beca89496aa1aa3581: Status 404 returned error can't find the container with id 8185d63db12a6b62ad0c0ad48085b4d482cb12ea2528b0beca89496aa1aa3581 Jul 06 21:04:51.072454 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:51.072417 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-registry-tls\") pod \"image-registry-65d484654d-d45tf\" (UID: \"21e6ad8b-efe9-4faf-a400-e1014c3dfbb5\") " pod="openshift-image-registry/image-registry-65d484654d-d45tf" Jul 06 21:04:51.073053 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:51.072525 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05fbf402-3b73-4ed1-a153-4e3367a41518-metrics-tls\") pod \"dns-default-pftrl\" (UID: \"05fbf402-3b73-4ed1-a153-4e3367a41518\") " pod="openshift-dns/dns-default-pftrl" Jul 06 21:04:51.073053 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:51.072579 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1867e5c6-1cdc-4302-b705-5c7cd807677b-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-f29qt\" (UID: \"1867e5c6-1cdc-4302-b705-5c7cd807677b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-f29qt" Jul 06 21:04:51.073053 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:51.072580 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 21:04:51.073053 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:51.072623 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 21:04:51.073053 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:51.072643 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65d484654d-d45tf: secret "image-registry-tls" not found Jul 06 21:04:51.073053 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:51.072688 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 21:04:51.073053 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:51.072708 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05fbf402-3b73-4ed1-a153-4e3367a41518-metrics-tls podName:05fbf402-3b73-4ed1-a153-4e3367a41518 nodeName:}" failed. No retries permitted until 2026-07-06 21:04:52.072689584 +0000 UTC m=+38.590927728 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/05fbf402-3b73-4ed1-a153-4e3367a41518-metrics-tls") pod "dns-default-pftrl" (UID: "05fbf402-3b73-4ed1-a153-4e3367a41518") : secret "dns-default-metrics-tls" not found Jul 06 21:04:51.073053 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:51.072730 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-registry-tls podName:21e6ad8b-efe9-4faf-a400-e1014c3dfbb5 nodeName:}" failed. No retries permitted until 2026-07-06 21:04:52.072719606 +0000 UTC m=+38.590957736 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-registry-tls") pod "image-registry-65d484654d-d45tf" (UID: "21e6ad8b-efe9-4faf-a400-e1014c3dfbb5") : secret "image-registry-tls" not found Jul 06 21:04:51.073053 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:51.072758 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1867e5c6-1cdc-4302-b705-5c7cd807677b-networking-console-plugin-cert podName:1867e5c6-1cdc-4302-b705-5c7cd807677b nodeName:}" failed. No retries permitted until 2026-07-06 21:04:52.072740765 +0000 UTC m=+38.590978889 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1867e5c6-1cdc-4302-b705-5c7cd807677b-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-f29qt" (UID: "1867e5c6-1cdc-4302-b705-5c7cd807677b") : secret "networking-console-plugin-cert" not found Jul 06 21:04:51.284377 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:51.284341 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-k5tm2" event={"ID":"22c46544-3b08-4ad7-8f17-8a1210bf99b4","Type":"ContainerStarted","Data":"8185d63db12a6b62ad0c0ad48085b4d482cb12ea2528b0beca89496aa1aa3581"} Jul 06 21:04:52.029686 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:52.029652 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvgtq" Jul 06 21:04:52.029686 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:52.029673 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c795j" Jul 06 21:04:52.029928 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:52.029651 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhsmf" Jul 06 21:04:52.034344 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:52.032448 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 21:04:52.034344 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:52.033287 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s8xqr\"" Jul 06 21:04:52.034344 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:52.033427 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 21:04:52.034344 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:52.033536 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 21:04:52.034344 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:52.033715 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 21:04:52.034344 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:52.033803 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f84wx\"" Jul 06 21:04:52.083518 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:52.083483 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05fbf402-3b73-4ed1-a153-4e3367a41518-metrics-tls\") pod \"dns-default-pftrl\" (UID: \"05fbf402-3b73-4ed1-a153-4e3367a41518\") " pod="openshift-dns/dns-default-pftrl" Jul 06 21:04:52.083944 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:52.083550 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1867e5c6-1cdc-4302-b705-5c7cd807677b-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-f29qt\" (UID: \"1867e5c6-1cdc-4302-b705-5c7cd807677b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-f29qt" Jul 06 21:04:52.083944 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:52.083591 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-registry-tls\") pod \"image-registry-65d484654d-d45tf\" (UID: \"21e6ad8b-efe9-4faf-a400-e1014c3dfbb5\") " pod="openshift-image-registry/image-registry-65d484654d-d45tf" Jul 06 21:04:52.083944 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:52.083685 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 21:04:52.083944 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:52.083700 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65d484654d-d45tf: secret "image-registry-tls" not found Jul 06 21:04:52.083944 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:52.083746 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 21:04:52.083944 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:52.083749 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-registry-tls podName:21e6ad8b-efe9-4faf-a400-e1014c3dfbb5 nodeName:}" failed. No retries permitted until 2026-07-06 21:04:54.083735892 +0000 UTC m=+40.601974021 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-registry-tls") pod "image-registry-65d484654d-d45tf" (UID: "21e6ad8b-efe9-4faf-a400-e1014c3dfbb5") : secret "image-registry-tls" not found Jul 06 21:04:52.083944 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:52.083822 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1867e5c6-1cdc-4302-b705-5c7cd807677b-networking-console-plugin-cert podName:1867e5c6-1cdc-4302-b705-5c7cd807677b nodeName:}" failed. No retries permitted until 2026-07-06 21:04:54.083803701 +0000 UTC m=+40.602041811 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1867e5c6-1cdc-4302-b705-5c7cd807677b-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-f29qt" (UID: "1867e5c6-1cdc-4302-b705-5c7cd807677b") : secret "networking-console-plugin-cert" not found Jul 06 21:04:52.083944 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:52.083683 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 21:04:52.083944 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:52.083856 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05fbf402-3b73-4ed1-a153-4e3367a41518-metrics-tls podName:05fbf402-3b73-4ed1-a153-4e3367a41518 nodeName:}" failed. No retries permitted until 2026-07-06 21:04:54.083845287 +0000 UTC m=+40.602083397 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/05fbf402-3b73-4ed1-a153-4e3367a41518-metrics-tls") pod "dns-default-pftrl" (UID: "05fbf402-3b73-4ed1-a153-4e3367a41518") : secret "dns-default-metrics-tls" not found Jul 06 21:04:54.101576 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:54.101543 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05fbf402-3b73-4ed1-a153-4e3367a41518-metrics-tls\") pod \"dns-default-pftrl\" (UID: \"05fbf402-3b73-4ed1-a153-4e3367a41518\") " pod="openshift-dns/dns-default-pftrl" Jul 06 21:04:54.102021 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:54.101607 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1867e5c6-1cdc-4302-b705-5c7cd807677b-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-f29qt\" (UID: \"1867e5c6-1cdc-4302-b705-5c7cd807677b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-f29qt" Jul 06 21:04:54.102021 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:54.101641 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-registry-tls\") pod \"image-registry-65d484654d-d45tf\" (UID: \"21e6ad8b-efe9-4faf-a400-e1014c3dfbb5\") " pod="openshift-image-registry/image-registry-65d484654d-d45tf" Jul 06 21:04:54.102021 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:54.101722 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 21:04:54.102021 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:54.101772 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 21:04:54.102021 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:54.101789 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65d484654d-d45tf: secret "image-registry-tls" not found Jul 06 21:04:54.102021 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:54.101793 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05fbf402-3b73-4ed1-a153-4e3367a41518-metrics-tls podName:05fbf402-3b73-4ed1-a153-4e3367a41518 nodeName:}" failed. No retries permitted until 2026-07-06 21:04:58.101777639 +0000 UTC m=+44.620015753 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/05fbf402-3b73-4ed1-a153-4e3367a41518-metrics-tls") pod "dns-default-pftrl" (UID: "05fbf402-3b73-4ed1-a153-4e3367a41518") : secret "dns-default-metrics-tls" not found Jul 06 21:04:54.102021 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:54.101836 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-registry-tls podName:21e6ad8b-efe9-4faf-a400-e1014c3dfbb5 nodeName:}" failed. No retries permitted until 2026-07-06 21:04:58.101820726 +0000 UTC m=+44.620058855 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-registry-tls") pod "image-registry-65d484654d-d45tf" (UID: "21e6ad8b-efe9-4faf-a400-e1014c3dfbb5") : secret "image-registry-tls" not found Jul 06 21:04:54.102021 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:54.101772 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 21:04:54.102021 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:54.101887 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1867e5c6-1cdc-4302-b705-5c7cd807677b-networking-console-plugin-cert podName:1867e5c6-1cdc-4302-b705-5c7cd807677b nodeName:}" failed. No retries permitted until 2026-07-06 21:04:58.101876652 +0000 UTC m=+44.620114765 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1867e5c6-1cdc-4302-b705-5c7cd807677b-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-f29qt" (UID: "1867e5c6-1cdc-4302-b705-5c7cd807677b") : secret "networking-console-plugin-cert" not found Jul 06 21:04:55.297237 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:55.297024 2563 generic.go:356] "Generic (PLEG): container finished" podID="2d9510b7-6982-4ead-a75a-e5816ef5b9ab" containerID="b92b2659d8876279fc7c5df96fc86e5614dfd9a2abedd7db78509b30556f7f30" exitCode=0 Jul 06 21:04:55.297663 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:55.297103 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p2h5x" event={"ID":"2d9510b7-6982-4ead-a75a-e5816ef5b9ab","Type":"ContainerDied","Data":"b92b2659d8876279fc7c5df96fc86e5614dfd9a2abedd7db78509b30556f7f30"} Jul 06 21:04:55.298742 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:55.298719 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-k5tm2" event={"ID":"22c46544-3b08-4ad7-8f17-8a1210bf99b4","Type":"ContainerStarted","Data":"fd0bc007d0f007c79dbda216740a01daaaeb1db00af129fdee6d3adad9271faf"} Jul 06 21:04:55.332547 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:55.332503 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-k5tm2" podStartSLOduration=1.3124480090000001 podStartE2EDuration="5.33248751s" totalImagesPullingTime="4.020039501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:04:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:04:55.331762987 +0000 UTC m=+41.850001141" watchObservedRunningTime="2026-07-06 21:04:55.33248751 +0000 UTC m=+41.850725642" Jul 06 21:04:56.304135 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:56.304100 2563 generic.go:356] "Generic (PLEG): container finished" podID="2d9510b7-6982-4ead-a75a-e5816ef5b9ab" containerID="a4c24653ca80aeb5828748459d2bc68376a232acbedfb1e9a34671d13314c299" exitCode=0 Jul 06 21:04:56.304625 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:56.304183 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p2h5x" event={"ID":"2d9510b7-6982-4ead-a75a-e5816ef5b9ab","Type":"ContainerDied","Data":"a4c24653ca80aeb5828748459d2bc68376a232acbedfb1e9a34671d13314c299"} Jul 06 21:04:57.313376 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:57.313342 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p2h5x" event={"ID":"2d9510b7-6982-4ead-a75a-e5816ef5b9ab","Type":"ContainerStarted","Data":"d18179497a41b54659f7e0eb9d8cfc2cc2e6234f43540e6fa1484601bef8cb03"} Jul 06 21:04:57.335826 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:57.335781 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-p2h5x" podStartSLOduration=8.945343804 podStartE2EDuration="43.335767437s" totalImagesPullingTime="34.390423633s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:04:14 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:04:57.335305497 +0000 UTC m=+43.853543631" watchObservedRunningTime="2026-07-06 21:04:57.335767437 +0000 UTC m=+43.854005569" Jul 06 21:04:58.136065 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:58.136025 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05fbf402-3b73-4ed1-a153-4e3367a41518-metrics-tls\") pod \"dns-default-pftrl\" (UID: \"05fbf402-3b73-4ed1-a153-4e3367a41518\") " pod="openshift-dns/dns-default-pftrl" Jul 06 21:04:58.136244 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:58.136076 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1867e5c6-1cdc-4302-b705-5c7cd807677b-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-f29qt\" (UID: \"1867e5c6-1cdc-4302-b705-5c7cd807677b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-f29qt" Jul 06 21:04:58.136244 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:58.136196 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 21:04:58.136340 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:04:58.136202 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-registry-tls\") pod \"image-registry-65d484654d-d45tf\" (UID: \"21e6ad8b-efe9-4faf-a400-e1014c3dfbb5\") " pod="openshift-image-registry/image-registry-65d484654d-d45tf" Jul 06 21:04:58.136340 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:58.136267 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05fbf402-3b73-4ed1-a153-4e3367a41518-metrics-tls podName:05fbf402-3b73-4ed1-a153-4e3367a41518 nodeName:}" failed. No retries permitted until 2026-07-06 21:05:06.136249959 +0000 UTC m=+52.654488088 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/05fbf402-3b73-4ed1-a153-4e3367a41518-metrics-tls") pod "dns-default-pftrl" (UID: "05fbf402-3b73-4ed1-a153-4e3367a41518") : secret "dns-default-metrics-tls" not found Jul 06 21:04:58.136340 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:58.136267 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 21:04:58.136340 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:58.136326 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 21:04:58.136472 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:58.136339 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65d484654d-d45tf: secret "image-registry-tls" not found Jul 06 21:04:58.136472 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:58.136371 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1867e5c6-1cdc-4302-b705-5c7cd807677b-networking-console-plugin-cert podName:1867e5c6-1cdc-4302-b705-5c7cd807677b nodeName:}" failed. No retries permitted until 2026-07-06 21:05:06.136359471 +0000 UTC m=+52.654597581 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1867e5c6-1cdc-4302-b705-5c7cd807677b-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-f29qt" (UID: "1867e5c6-1cdc-4302-b705-5c7cd807677b") : secret "networking-console-plugin-cert" not found Jul 06 21:04:58.136472 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:04:58.136398 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-registry-tls podName:21e6ad8b-efe9-4faf-a400-e1014c3dfbb5 nodeName:}" failed. No retries permitted until 2026-07-06 21:05:06.136379347 +0000 UTC m=+52.654617488 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-registry-tls") pod "image-registry-65d484654d-d45tf" (UID: "21e6ad8b-efe9-4faf-a400-e1014c3dfbb5") : secret "image-registry-tls" not found Jul 06 21:05:06.195107 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:05:06.195064 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-registry-tls\") pod \"image-registry-65d484654d-d45tf\" (UID: \"21e6ad8b-efe9-4faf-a400-e1014c3dfbb5\") " pod="openshift-image-registry/image-registry-65d484654d-d45tf" Jul 06 21:05:06.195788 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:05:06.195763 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05fbf402-3b73-4ed1-a153-4e3367a41518-metrics-tls\") pod \"dns-default-pftrl\" (UID: \"05fbf402-3b73-4ed1-a153-4e3367a41518\") " pod="openshift-dns/dns-default-pftrl" Jul 06 21:05:06.195944 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:05:06.195926 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1867e5c6-1cdc-4302-b705-5c7cd807677b-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-f29qt\" (UID: \"1867e5c6-1cdc-4302-b705-5c7cd807677b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-f29qt" Jul 06 21:05:06.196165 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:05:06.196150 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 21:05:06.196347 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:05:06.196335 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1867e5c6-1cdc-4302-b705-5c7cd807677b-networking-console-plugin-cert podName:1867e5c6-1cdc-4302-b705-5c7cd807677b nodeName:}" failed. No retries permitted until 2026-07-06 21:05:22.196294404 +0000 UTC m=+68.714532531 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1867e5c6-1cdc-4302-b705-5c7cd807677b-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-f29qt" (UID: "1867e5c6-1cdc-4302-b705-5c7cd807677b") : secret "networking-console-plugin-cert" not found Jul 06 21:05:06.196534 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:05:06.196522 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 21:05:06.196626 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:05:06.196616 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65d484654d-d45tf: secret "image-registry-tls" not found Jul 06 21:05:06.196752 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:05:06.196742 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-registry-tls podName:21e6ad8b-efe9-4faf-a400-e1014c3dfbb5 nodeName:}" failed. No retries permitted until 2026-07-06 21:05:22.196719907 +0000 UTC m=+68.714958037 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-registry-tls") pod "image-registry-65d484654d-d45tf" (UID: "21e6ad8b-efe9-4faf-a400-e1014c3dfbb5") : secret "image-registry-tls" not found Jul 06 21:05:06.196905 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:05:06.196894 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 21:05:06.197018 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:05:06.197009 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05fbf402-3b73-4ed1-a153-4e3367a41518-metrics-tls podName:05fbf402-3b73-4ed1-a153-4e3367a41518 nodeName:}" failed. No retries permitted until 2026-07-06 21:05:22.19698927 +0000 UTC m=+68.715227380 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/05fbf402-3b73-4ed1-a153-4e3367a41518-metrics-tls") pod "dns-default-pftrl" (UID: "05fbf402-3b73-4ed1-a153-4e3367a41518") : secret "dns-default-metrics-tls" not found Jul 06 21:05:17.281363 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:05:17.281334 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nsmng" Jul 06 21:05:20.002198 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:05:20.002160 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1dc41f0-1699-4e7b-bebc-15f2494d9d23-original-pull-secret\") pod \"global-pull-secret-syncer-vhsmf\" (UID: \"a1dc41f0-1699-4e7b-bebc-15f2494d9d23\") " pod="kube-system/global-pull-secret-syncer-vhsmf" Jul 06 21:05:20.002198 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:05:20.002201 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/084dc07e-e49b-44e3-95cc-11e11c5037a5-metrics-certs\") pod \"network-metrics-daemon-c795j\" (UID: \"084dc07e-e49b-44e3-95cc-11e11c5037a5\") " pod="openshift-multus/network-metrics-daemon-c795j" Jul 06 21:05:20.004889 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:05:20.004868 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 21:05:20.004989 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:05:20.004876 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 21:05:20.013056 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:05:20.013038 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 06 21:05:20.013116 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:05:20.013100 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/084dc07e-e49b-44e3-95cc-11e11c5037a5-metrics-certs podName:084dc07e-e49b-44e3-95cc-11e11c5037a5 nodeName:}" failed. No retries permitted until 2026-07-06 21:06:24.013085142 +0000 UTC m=+130.531323253 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/084dc07e-e49b-44e3-95cc-11e11c5037a5-metrics-certs") pod "network-metrics-daemon-c795j" (UID: "084dc07e-e49b-44e3-95cc-11e11c5037a5") : secret "metrics-daemon-secret" not found Jul 06 21:05:20.015928 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:05:20.015911 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1dc41f0-1699-4e7b-bebc-15f2494d9d23-original-pull-secret\") pod \"global-pull-secret-syncer-vhsmf\" (UID: \"a1dc41f0-1699-4e7b-bebc-15f2494d9d23\") " pod="kube-system/global-pull-secret-syncer-vhsmf" Jul 06 21:05:20.103161 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:05:20.103128 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8drhf\" (UniqueName: \"kubernetes.io/projected/f107cce5-b80b-4c37-9d88-e582acb83168-kube-api-access-8drhf\") pod \"network-check-target-lvgtq\" (UID: \"f107cce5-b80b-4c37-9d88-e582acb83168\") " pod="openshift-network-diagnostics/network-check-target-lvgtq" Jul 06 21:05:20.106130 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:05:20.106110 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 21:05:20.116431 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:05:20.116410 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 21:05:20.126861 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:05:20.126837 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8drhf\" (UniqueName: \"kubernetes.io/projected/f107cce5-b80b-4c37-9d88-e582acb83168-kube-api-access-8drhf\") pod \"network-check-target-lvgtq\" (UID: \"f107cce5-b80b-4c37-9d88-e582acb83168\") " pod="openshift-network-diagnostics/network-check-target-lvgtq" Jul 06 21:05:20.245403 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:05:20.245373 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f84wx\"" Jul 06 21:05:20.251221 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:05:20.251206 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhsmf" Jul 06 21:05:20.253400 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:05:20.253350 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lvgtq" Jul 06 21:05:20.395969 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:05:20.395938 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vhsmf"] Jul 06 21:05:20.399144 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:05:20.399120 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1dc41f0_1699_4e7b_bebc_15f2494d9d23.slice/crio-f59736ef810ee921e0ded70a3eab7229b5ed019ce52022bea3af338e3ca273f3 WatchSource:0}: Error finding container f59736ef810ee921e0ded70a3eab7229b5ed019ce52022bea3af338e3ca273f3: Status 404 returned error can't find the container with id f59736ef810ee921e0ded70a3eab7229b5ed019ce52022bea3af338e3ca273f3 Jul 06 21:05:20.414389 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:05:20.414370 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lvgtq"] Jul 06 21:05:20.416520 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:05:20.416499 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf107cce5_b80b_4c37_9d88_e582acb83168.slice/crio-09fec8cd4719bf1768ed1c6dfcebfbb1a11adc80ae738a28e0d63b1bd53fbd29 WatchSource:0}: Error finding container 09fec8cd4719bf1768ed1c6dfcebfbb1a11adc80ae738a28e0d63b1bd53fbd29: Status 404 returned error can't find the container with id 09fec8cd4719bf1768ed1c6dfcebfbb1a11adc80ae738a28e0d63b1bd53fbd29 Jul 06 21:05:21.371061 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:05:21.371024 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lvgtq" event={"ID":"f107cce5-b80b-4c37-9d88-e582acb83168","Type":"ContainerStarted","Data":"09fec8cd4719bf1768ed1c6dfcebfbb1a11adc80ae738a28e0d63b1bd53fbd29"} Jul 06 21:05:21.372705 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:05:21.372667 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vhsmf" event={"ID":"a1dc41f0-1699-4e7b-bebc-15f2494d9d23","Type":"ContainerStarted","Data":"f59736ef810ee921e0ded70a3eab7229b5ed019ce52022bea3af338e3ca273f3"} Jul 06 21:05:22.220522 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:05:22.220462 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05fbf402-3b73-4ed1-a153-4e3367a41518-metrics-tls\") pod \"dns-default-pftrl\" (UID: \"05fbf402-3b73-4ed1-a153-4e3367a41518\") " pod="openshift-dns/dns-default-pftrl" Jul 06 21:05:22.220522 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:05:22.220528 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1867e5c6-1cdc-4302-b705-5c7cd807677b-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-f29qt\" (UID: \"1867e5c6-1cdc-4302-b705-5c7cd807677b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-f29qt" Jul 06 21:05:22.220784 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:05:22.220568 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-registry-tls\") pod \"image-registry-65d484654d-d45tf\" (UID: \"21e6ad8b-efe9-4faf-a400-e1014c3dfbb5\") " pod="openshift-image-registry/image-registry-65d484654d-d45tf" Jul 06 21:05:22.220784 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:05:22.220643 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 21:05:22.220784 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:05:22.220723 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05fbf402-3b73-4ed1-a153-4e3367a41518-metrics-tls podName:05fbf402-3b73-4ed1-a153-4e3367a41518 nodeName:}" failed. No retries permitted until 2026-07-06 21:05:54.220704024 +0000 UTC m=+100.738942157 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/05fbf402-3b73-4ed1-a153-4e3367a41518-metrics-tls") pod "dns-default-pftrl" (UID: "05fbf402-3b73-4ed1-a153-4e3367a41518") : secret "dns-default-metrics-tls" not found Jul 06 21:05:22.220784 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:05:22.220723 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 21:05:22.220784 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:05:22.220644 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 21:05:22.221212 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:05:22.220802 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1867e5c6-1cdc-4302-b705-5c7cd807677b-networking-console-plugin-cert podName:1867e5c6-1cdc-4302-b705-5c7cd807677b nodeName:}" failed. No retries permitted until 2026-07-06 21:05:54.220782839 +0000 UTC m=+100.739020962 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1867e5c6-1cdc-4302-b705-5c7cd807677b-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-f29qt" (UID: "1867e5c6-1cdc-4302-b705-5c7cd807677b") : secret "networking-console-plugin-cert" not found Jul 06 21:05:22.221212 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:05:22.220741 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65d484654d-d45tf: secret "image-registry-tls" not found Jul 06 21:05:22.221212 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:05:22.220889 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-registry-tls podName:21e6ad8b-efe9-4faf-a400-e1014c3dfbb5 nodeName:}" failed. No retries permitted until 2026-07-06 21:05:54.220871428 +0000 UTC m=+100.739109552 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-registry-tls") pod "image-registry-65d484654d-d45tf" (UID: "21e6ad8b-efe9-4faf-a400-e1014c3dfbb5") : secret "image-registry-tls" not found Jul 06 21:05:24.382751 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:05:24.382716 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lvgtq" event={"ID":"f107cce5-b80b-4c37-9d88-e582acb83168","Type":"ContainerStarted","Data":"909acd6ed3ec1be1baf027c32fa744472cd3a81bbf5f40249e91f72f4e2bcb01"} Jul 06 21:05:24.383204 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:05:24.382931 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-lvgtq" Jul 06 21:05:24.398654 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:05:24.398597 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-lvgtq" podStartSLOduration=66.790718047 podStartE2EDuration="1m10.398582237s" totalImagesPullingTime="3.60786419s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:04:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:05:24.397832067 +0000 UTC m=+70.916070201" watchObservedRunningTime="2026-07-06 21:05:24.398582237 +0000 UTC m=+70.916820347" Jul 06 21:05:26.388695 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:05:26.388645 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vhsmf" event={"ID":"a1dc41f0-1699-4e7b-bebc-15f2494d9d23","Type":"ContainerStarted","Data":"e6ea2e9543a7740cc1eeaa2b43b1289c140ec6d4d9eb21eeadb85fd23219d27c"} Jul 06 21:05:54.254504 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:05:54.254401 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05fbf402-3b73-4ed1-a153-4e3367a41518-metrics-tls\") pod \"dns-default-pftrl\" (UID: \"05fbf402-3b73-4ed1-a153-4e3367a41518\") " pod="openshift-dns/dns-default-pftrl" Jul 06 21:05:54.254504 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:05:54.254460 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1867e5c6-1cdc-4302-b705-5c7cd807677b-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-f29qt\" (UID: \"1867e5c6-1cdc-4302-b705-5c7cd807677b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-f29qt" Jul 06 21:05:54.254504 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:05:54.254493 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-registry-tls\") pod \"image-registry-65d484654d-d45tf\" (UID: \"21e6ad8b-efe9-4faf-a400-e1014c3dfbb5\") " pod="openshift-image-registry/image-registry-65d484654d-d45tf" Jul 06 21:05:54.254972 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:05:54.254552 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 21:05:54.254972 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:05:54.254597 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 21:05:54.254972 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:05:54.254611 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65d484654d-d45tf: secret "image-registry-tls" not found Jul 06 21:05:54.254972 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:05:54.254614 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 21:05:54.254972 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:05:54.254624 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05fbf402-3b73-4ed1-a153-4e3367a41518-metrics-tls podName:05fbf402-3b73-4ed1-a153-4e3367a41518 nodeName:}" failed. No retries permitted until 2026-07-06 21:06:58.254607548 +0000 UTC m=+164.772845685 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/05fbf402-3b73-4ed1-a153-4e3367a41518-metrics-tls") pod "dns-default-pftrl" (UID: "05fbf402-3b73-4ed1-a153-4e3367a41518") : secret "dns-default-metrics-tls" not found Jul 06 21:05:54.254972 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:05:54.254660 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-registry-tls podName:21e6ad8b-efe9-4faf-a400-e1014c3dfbb5 nodeName:}" failed. No retries permitted until 2026-07-06 21:06:58.254644189 +0000 UTC m=+164.772882381 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-registry-tls") pod "image-registry-65d484654d-d45tf" (UID: "21e6ad8b-efe9-4faf-a400-e1014c3dfbb5") : secret "image-registry-tls" not found Jul 06 21:05:54.254972 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:05:54.254675 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1867e5c6-1cdc-4302-b705-5c7cd807677b-networking-console-plugin-cert podName:1867e5c6-1cdc-4302-b705-5c7cd807677b nodeName:}" failed. No retries permitted until 2026-07-06 21:06:58.25466875 +0000 UTC m=+164.772906861 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1867e5c6-1cdc-4302-b705-5c7cd807677b-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-f29qt" (UID: "1867e5c6-1cdc-4302-b705-5c7cd807677b") : secret "networking-console-plugin-cert" not found Jul 06 21:05:55.387910 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:05:55.387882 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-lvgtq" Jul 06 21:05:55.402913 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:05:55.402858 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vhsmf" podStartSLOduration=96.351380994 podStartE2EDuration="1m41.402843854s" totalImagesPullingTime="5.05146286s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:04:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:05:26.404275297 +0000 UTC m=+72.922513458" watchObservedRunningTime="2026-07-06 21:05:55.402843854 +0000 UTC m=+101.921081986" Jul 06 21:06:24.080916 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:06:24.080875 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/084dc07e-e49b-44e3-95cc-11e11c5037a5-metrics-certs\") pod \"network-metrics-daemon-c795j\" (UID: \"084dc07e-e49b-44e3-95cc-11e11c5037a5\") " pod="openshift-multus/network-metrics-daemon-c795j" Jul 06 21:06:24.081438 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:06:24.081020 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 06 21:06:24.081438 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:06:24.081089 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/084dc07e-e49b-44e3-95cc-11e11c5037a5-metrics-certs podName:084dc07e-e49b-44e3-95cc-11e11c5037a5 nodeName:}" failed. No retries permitted until 2026-07-06 21:08:26.081073876 +0000 UTC m=+252.599312004 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/084dc07e-e49b-44e3-95cc-11e11c5037a5-metrics-certs") pod "network-metrics-daemon-c795j" (UID: "084dc07e-e49b-44e3-95cc-11e11c5037a5") : secret "metrics-daemon-secret" not found Jul 06 21:06:53.355607 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:06:53.355561 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6bffdf9778-f29qt" podUID="1867e5c6-1cdc-4302-b705-5c7cd807677b" Jul 06 21:06:53.360737 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:06:53.360713 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-65d484654d-d45tf" podUID="21e6ad8b-efe9-4faf-a400-e1014c3dfbb5" Jul 06 21:06:53.382155 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:06:53.382125 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-pftrl" podUID="05fbf402-3b73-4ed1-a153-4e3367a41518" Jul 06 21:06:53.592660 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:06:53.592630 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pftrl" Jul 06 21:06:53.592799 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:06:53.592630 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-f29qt" Jul 06 21:06:53.592799 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:06:53.592636 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65d484654d-d45tf" Jul 06 21:06:55.057804 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:06:55.057752 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-c795j" podUID="084dc07e-e49b-44e3-95cc-11e11c5037a5" Jul 06 21:06:58.323440 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:06:58.323397 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05fbf402-3b73-4ed1-a153-4e3367a41518-metrics-tls\") pod \"dns-default-pftrl\" (UID: \"05fbf402-3b73-4ed1-a153-4e3367a41518\") " pod="openshift-dns/dns-default-pftrl" Jul 06 21:06:58.323440 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:06:58.323442 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1867e5c6-1cdc-4302-b705-5c7cd807677b-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-f29qt\" (UID: \"1867e5c6-1cdc-4302-b705-5c7cd807677b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-f29qt" Jul 06 21:06:58.323909 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:06:58.323538 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 21:06:58.323909 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:06:58.323555 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 21:06:58.323909 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:06:58.323564 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-registry-tls\") pod \"image-registry-65d484654d-d45tf\" (UID: \"21e6ad8b-efe9-4faf-a400-e1014c3dfbb5\") " pod="openshift-image-registry/image-registry-65d484654d-d45tf" Jul 06 21:06:58.323909 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:06:58.323609 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1867e5c6-1cdc-4302-b705-5c7cd807677b-networking-console-plugin-cert podName:1867e5c6-1cdc-4302-b705-5c7cd807677b nodeName:}" failed. No retries permitted until 2026-07-06 21:09:00.323590852 +0000 UTC m=+286.841828988 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1867e5c6-1cdc-4302-b705-5c7cd807677b-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-f29qt" (UID: "1867e5c6-1cdc-4302-b705-5c7cd807677b") : secret "networking-console-plugin-cert" not found Jul 06 21:06:58.323909 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:06:58.323631 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05fbf402-3b73-4ed1-a153-4e3367a41518-metrics-tls podName:05fbf402-3b73-4ed1-a153-4e3367a41518 nodeName:}" failed. No retries permitted until 2026-07-06 21:09:00.323620893 +0000 UTC m=+286.841859009 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/05fbf402-3b73-4ed1-a153-4e3367a41518-metrics-tls") pod "dns-default-pftrl" (UID: "05fbf402-3b73-4ed1-a153-4e3367a41518") : secret "dns-default-metrics-tls" not found Jul 06 21:06:58.323909 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:06:58.323648 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 21:06:58.323909 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:06:58.323661 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65d484654d-d45tf: secret "image-registry-tls" not found Jul 06 21:06:58.323909 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:06:58.323712 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-registry-tls podName:21e6ad8b-efe9-4faf-a400-e1014c3dfbb5 nodeName:}" failed. No retries permitted until 2026-07-06 21:09:00.323699463 +0000 UTC m=+286.841937586 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-registry-tls") pod "image-registry-65d484654d-d45tf" (UID: "21e6ad8b-efe9-4faf-a400-e1014c3dfbb5") : secret "image-registry-tls" not found Jul 06 21:07:09.029597 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:07:09.029514 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c795j" Jul 06 21:08:26.147426 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:26.147381 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/084dc07e-e49b-44e3-95cc-11e11c5037a5-metrics-certs\") pod \"network-metrics-daemon-c795j\" (UID: \"084dc07e-e49b-44e3-95cc-11e11c5037a5\") " pod="openshift-multus/network-metrics-daemon-c795j" Jul 06 21:08:26.147924 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:08:26.147540 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 06 21:08:26.147924 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:08:26.147603 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/084dc07e-e49b-44e3-95cc-11e11c5037a5-metrics-certs podName:084dc07e-e49b-44e3-95cc-11e11c5037a5 nodeName:}" failed. No retries permitted until 2026-07-06 21:10:28.147587699 +0000 UTC m=+374.665825809 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/084dc07e-e49b-44e3-95cc-11e11c5037a5-metrics-certs") pod "network-metrics-daemon-c795j" (UID: "084dc07e-e49b-44e3-95cc-11e11c5037a5") : secret "metrics-daemon-secret" not found Jul 06 21:08:31.323008 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.322972 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hcx9k"] Jul 06 21:08:31.324765 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.324714 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-kmj89"] Jul 06 21:08:31.325020 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.324880 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hcx9k" Jul 06 21:08:31.326615 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.326594 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-z727m"] Jul 06 21:08:31.326710 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.326694 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-kmj89" Jul 06 21:08:31.328355 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.328335 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-vsz75"] Jul 06 21:08:31.328447 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.328405 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-z727m" Jul 06 21:08:31.329221 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.329191 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 06 21:08:31.329341 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.329303 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 21:08:31.329510 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.329491 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-9v6xg\"" Jul 06 21:08:31.329925 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.329913 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 06 21:08:31.330074 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.330059 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-vsz75" Jul 06 21:08:31.331758 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.331740 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 21:08:31.331973 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.331952 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 06 21:08:31.332085 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.331990 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-p2rnb\"" Jul 06 21:08:31.332085 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.332000 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 06 21:08:31.332085 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.332006 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 06 21:08:31.332085 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.332030 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 06 21:08:31.332085 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.332031 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 06 21:08:31.332910 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.332596 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 06 21:08:31.343022 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.343005 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-lc88p\"" Jul 06 21:08:31.344537 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.344521 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 06 21:08:31.345643 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.345625 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-4xzst\"" Jul 06 21:08:31.347300 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.347274 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 06 21:08:31.350997 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.350981 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 21:08:31.354742 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.354275 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 21:08:31.360041 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.360022 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 06 21:08:31.366836 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.366812 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-z727m"] Jul 06 21:08:31.379295 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.379273 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-kmj89"] Jul 06 21:08:31.379944 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.379926 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hcx9k"] Jul 06 21:08:31.382837 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.382815 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e6c752c6-9cfb-4761-b7ce-ca3e2d37e6a2-snapshots\") pod \"insights-operator-5c847dcfc4-vsz75\" (UID: \"e6c752c6-9cfb-4761-b7ce-ca3e2d37e6a2\") " pod="openshift-insights/insights-operator-5c847dcfc4-vsz75" Jul 06 21:08:31.382925 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.382854 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f34a6f22-ec93-487d-92c1-b878b40f217e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-hcx9k\" (UID: \"f34a6f22-ec93-487d-92c1-b878b40f217e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hcx9k" Jul 06 21:08:31.382925 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.382901 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d8331c1e-5061-4874-9338-e9daf1c79b83-config\") pod \"service-ca-operator-5d46d9ffd4-z727m\" (UID: \"d8331c1e-5061-4874-9338-e9daf1c79b83\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-z727m" Jul 06 21:08:31.383009 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.382970 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e6c752c6-9cfb-4761-b7ce-ca3e2d37e6a2-serving-cert\") pod \"insights-operator-5c847dcfc4-vsz75\" (UID: \"e6c752c6-9cfb-4761-b7ce-ca3e2d37e6a2\") " pod="openshift-insights/insights-operator-5c847dcfc4-vsz75" Jul 06 21:08:31.383047 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.383021 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvlzf\" (UniqueName: \"kubernetes.io/projected/d8331c1e-5061-4874-9338-e9daf1c79b83-kube-api-access-tvlzf\") pod \"service-ca-operator-5d46d9ffd4-z727m\" (UID: \"d8331c1e-5061-4874-9338-e9daf1c79b83\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-z727m" Jul 06 21:08:31.383179 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.383139 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6c752c6-9cfb-4761-b7ce-ca3e2d37e6a2-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-vsz75\" (UID: \"e6c752c6-9cfb-4761-b7ce-ca3e2d37e6a2\") " pod="openshift-insights/insights-operator-5c847dcfc4-vsz75" Jul 06 21:08:31.383237 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.383186 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6c752c6-9cfb-4761-b7ce-ca3e2d37e6a2-tmp\") pod \"insights-operator-5c847dcfc4-vsz75\" (UID: \"e6c752c6-9cfb-4761-b7ce-ca3e2d37e6a2\") " pod="openshift-insights/insights-operator-5c847dcfc4-vsz75" Jul 06 21:08:31.383237 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.383213 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6c752c6-9cfb-4761-b7ce-ca3e2d37e6a2-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-vsz75\" (UID: \"e6c752c6-9cfb-4761-b7ce-ca3e2d37e6a2\") " pod="openshift-insights/insights-operator-5c847dcfc4-vsz75" Jul 06 21:08:31.383350 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.383237 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f34a6f22-ec93-487d-92c1-b878b40f217e-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-hcx9k\" (UID: \"f34a6f22-ec93-487d-92c1-b878b40f217e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hcx9k" Jul 06 21:08:31.383350 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.383266 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-727r7\" (UniqueName: \"kubernetes.io/projected/1f61871c-5112-4899-b3f7-4c88752b416f-kube-api-access-727r7\") pod \"volume-data-source-validator-5d456fdbcd-kmj89\" (UID: \"1f61871c-5112-4899-b3f7-4c88752b416f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-kmj89" Jul 06 21:08:31.383350 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.383287 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rf8g\" (UniqueName: \"kubernetes.io/projected/f34a6f22-ec93-487d-92c1-b878b40f217e-kube-api-access-9rf8g\") pod \"cluster-monitoring-operator-64786d9cbb-hcx9k\" (UID: \"f34a6f22-ec93-487d-92c1-b878b40f217e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hcx9k" Jul 06 21:08:31.383489 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.383417 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsbdd\" (UniqueName: \"kubernetes.io/projected/e6c752c6-9cfb-4761-b7ce-ca3e2d37e6a2-kube-api-access-nsbdd\") pod \"insights-operator-5c847dcfc4-vsz75\" (UID: \"e6c752c6-9cfb-4761-b7ce-ca3e2d37e6a2\") " pod="openshift-insights/insights-operator-5c847dcfc4-vsz75" Jul 06 21:08:31.383489 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.383438 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d8331c1e-5061-4874-9338-e9daf1c79b83-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-z727m\" (UID: \"d8331c1e-5061-4874-9338-e9daf1c79b83\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-z727m" Jul 06 21:08:31.384718 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.384701 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-vsz75"] Jul 06 21:08:31.422360 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.422333 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vcp8r"] Jul 06 21:08:31.424258 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.424244 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vcp8r" Jul 06 21:08:31.427104 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.427081 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 06 21:08:31.427406 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.427372 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 06 21:08:31.427406 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.427403 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 06 21:08:31.427563 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.427409 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 06 21:08:31.427563 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.427427 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-nl2gh\"" Jul 06 21:08:31.437652 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.437633 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vcp8r"] Jul 06 21:08:31.484225 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.484199 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d8331c1e-5061-4874-9338-e9daf1c79b83-config\") pod \"service-ca-operator-5d46d9ffd4-z727m\" (UID: \"d8331c1e-5061-4874-9338-e9daf1c79b83\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-z727m" Jul 06 21:08:31.484526 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.484240 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e6c752c6-9cfb-4761-b7ce-ca3e2d37e6a2-serving-cert\") pod \"insights-operator-5c847dcfc4-vsz75\" (UID: \"e6c752c6-9cfb-4761-b7ce-ca3e2d37e6a2\") " pod="openshift-insights/insights-operator-5c847dcfc4-vsz75" Jul 06 21:08:31.484526 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.484260 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvlzf\" (UniqueName: \"kubernetes.io/projected/d8331c1e-5061-4874-9338-e9daf1c79b83-kube-api-access-tvlzf\") pod \"service-ca-operator-5d46d9ffd4-z727m\" (UID: \"d8331c1e-5061-4874-9338-e9daf1c79b83\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-z727m" Jul 06 21:08:31.484526 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.484422 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6c752c6-9cfb-4761-b7ce-ca3e2d37e6a2-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-vsz75\" (UID: \"e6c752c6-9cfb-4761-b7ce-ca3e2d37e6a2\") " pod="openshift-insights/insights-operator-5c847dcfc4-vsz75" Jul 06 21:08:31.484526 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.484480 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6c752c6-9cfb-4761-b7ce-ca3e2d37e6a2-tmp\") pod \"insights-operator-5c847dcfc4-vsz75\" (UID: \"e6c752c6-9cfb-4761-b7ce-ca3e2d37e6a2\") " pod="openshift-insights/insights-operator-5c847dcfc4-vsz75" Jul 06 21:08:31.484526 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.484516 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6c752c6-9cfb-4761-b7ce-ca3e2d37e6a2-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-vsz75\" (UID: \"e6c752c6-9cfb-4761-b7ce-ca3e2d37e6a2\") " pod="openshift-insights/insights-operator-5c847dcfc4-vsz75" Jul 06 21:08:31.484795 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.484546 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/826404fc-09bb-44da-bd6a-3d071e3009c8-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-vcp8r\" (UID: \"826404fc-09bb-44da-bd6a-3d071e3009c8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vcp8r" Jul 06 21:08:31.484795 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.484580 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f34a6f22-ec93-487d-92c1-b878b40f217e-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-hcx9k\" (UID: \"f34a6f22-ec93-487d-92c1-b878b40f217e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hcx9k" Jul 06 21:08:31.484795 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.484619 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-727r7\" (UniqueName: \"kubernetes.io/projected/1f61871c-5112-4899-b3f7-4c88752b416f-kube-api-access-727r7\") pod \"volume-data-source-validator-5d456fdbcd-kmj89\" (UID: \"1f61871c-5112-4899-b3f7-4c88752b416f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-kmj89" Jul 06 21:08:31.484795 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.484647 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rf8g\" (UniqueName: \"kubernetes.io/projected/f34a6f22-ec93-487d-92c1-b878b40f217e-kube-api-access-9rf8g\") pod \"cluster-monitoring-operator-64786d9cbb-hcx9k\" (UID: \"f34a6f22-ec93-487d-92c1-b878b40f217e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hcx9k" Jul 06 21:08:31.484795 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.484726 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsbdd\" (UniqueName: \"kubernetes.io/projected/e6c752c6-9cfb-4761-b7ce-ca3e2d37e6a2-kube-api-access-nsbdd\") pod \"insights-operator-5c847dcfc4-vsz75\" (UID: \"e6c752c6-9cfb-4761-b7ce-ca3e2d37e6a2\") " pod="openshift-insights/insights-operator-5c847dcfc4-vsz75" Jul 06 21:08:31.484795 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.484756 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d8331c1e-5061-4874-9338-e9daf1c79b83-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-z727m\" (UID: \"d8331c1e-5061-4874-9338-e9daf1c79b83\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-z727m" Jul 06 21:08:31.485073 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.484796 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/826404fc-09bb-44da-bd6a-3d071e3009c8-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-vcp8r\" (UID: \"826404fc-09bb-44da-bd6a-3d071e3009c8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vcp8r" Jul 06 21:08:31.485073 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.484833 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e6c752c6-9cfb-4761-b7ce-ca3e2d37e6a2-snapshots\") pod \"insights-operator-5c847dcfc4-vsz75\" (UID: \"e6c752c6-9cfb-4761-b7ce-ca3e2d37e6a2\") " pod="openshift-insights/insights-operator-5c847dcfc4-vsz75" Jul 06 21:08:31.485073 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.484862 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f34a6f22-ec93-487d-92c1-b878b40f217e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-hcx9k\" (UID: \"f34a6f22-ec93-487d-92c1-b878b40f217e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hcx9k" Jul 06 21:08:31.485073 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.484899 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7n72\" (UniqueName: \"kubernetes.io/projected/826404fc-09bb-44da-bd6a-3d071e3009c8-kube-api-access-j7n72\") pod \"kube-storage-version-migrator-operator-846bf668f7-vcp8r\" (UID: \"826404fc-09bb-44da-bd6a-3d071e3009c8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vcp8r" Jul 06 21:08:31.485073 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.484939 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6c752c6-9cfb-4761-b7ce-ca3e2d37e6a2-tmp\") pod \"insights-operator-5c847dcfc4-vsz75\" (UID: \"e6c752c6-9cfb-4761-b7ce-ca3e2d37e6a2\") " pod="openshift-insights/insights-operator-5c847dcfc4-vsz75" Jul 06 21:08:31.485073 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.484945 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d8331c1e-5061-4874-9338-e9daf1c79b83-config\") pod \"service-ca-operator-5d46d9ffd4-z727m\" (UID: \"d8331c1e-5061-4874-9338-e9daf1c79b83\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-z727m" Jul 06 21:08:31.485630 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.485552 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f34a6f22-ec93-487d-92c1-b878b40f217e-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-hcx9k\" (UID: \"f34a6f22-ec93-487d-92c1-b878b40f217e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hcx9k" Jul 06 21:08:31.485723 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:08:31.485643 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 21:08:31.485723 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:08:31.485714 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f34a6f22-ec93-487d-92c1-b878b40f217e-cluster-monitoring-operator-tls podName:f34a6f22-ec93-487d-92c1-b878b40f217e nodeName:}" failed. No retries permitted until 2026-07-06 21:08:31.985695826 +0000 UTC m=+258.503933954 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f34a6f22-ec93-487d-92c1-b878b40f217e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-hcx9k" (UID: "f34a6f22-ec93-487d-92c1-b878b40f217e") : secret "cluster-monitoring-operator-tls" not found Jul 06 21:08:31.485876 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.485859 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6c752c6-9cfb-4761-b7ce-ca3e2d37e6a2-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-vsz75\" (UID: \"e6c752c6-9cfb-4761-b7ce-ca3e2d37e6a2\") " pod="openshift-insights/insights-operator-5c847dcfc4-vsz75" Jul 06 21:08:31.486105 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.486085 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e6c752c6-9cfb-4761-b7ce-ca3e2d37e6a2-snapshots\") pod \"insights-operator-5c847dcfc4-vsz75\" (UID: \"e6c752c6-9cfb-4761-b7ce-ca3e2d37e6a2\") " pod="openshift-insights/insights-operator-5c847dcfc4-vsz75" Jul 06 21:08:31.486479 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.486427 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6c752c6-9cfb-4761-b7ce-ca3e2d37e6a2-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-vsz75\" (UID: \"e6c752c6-9cfb-4761-b7ce-ca3e2d37e6a2\") " pod="openshift-insights/insights-operator-5c847dcfc4-vsz75" Jul 06 21:08:31.487094 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.487070 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e6c752c6-9cfb-4761-b7ce-ca3e2d37e6a2-serving-cert\") pod \"insights-operator-5c847dcfc4-vsz75\" (UID: \"e6c752c6-9cfb-4761-b7ce-ca3e2d37e6a2\") " pod="openshift-insights/insights-operator-5c847dcfc4-vsz75" Jul 06 21:08:31.487266 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.487250 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d8331c1e-5061-4874-9338-e9daf1c79b83-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-z727m\" (UID: \"d8331c1e-5061-4874-9338-e9daf1c79b83\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-z727m" Jul 06 21:08:31.492986 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.492954 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvlzf\" (UniqueName: \"kubernetes.io/projected/d8331c1e-5061-4874-9338-e9daf1c79b83-kube-api-access-tvlzf\") pod \"service-ca-operator-5d46d9ffd4-z727m\" (UID: \"d8331c1e-5061-4874-9338-e9daf1c79b83\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-z727m" Jul 06 21:08:31.493373 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.493354 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-727r7\" (UniqueName: \"kubernetes.io/projected/1f61871c-5112-4899-b3f7-4c88752b416f-kube-api-access-727r7\") pod \"volume-data-source-validator-5d456fdbcd-kmj89\" (UID: \"1f61871c-5112-4899-b3f7-4c88752b416f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-kmj89" Jul 06 21:08:31.493689 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.493672 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsbdd\" (UniqueName: \"kubernetes.io/projected/e6c752c6-9cfb-4761-b7ce-ca3e2d37e6a2-kube-api-access-nsbdd\") pod \"insights-operator-5c847dcfc4-vsz75\" (UID: \"e6c752c6-9cfb-4761-b7ce-ca3e2d37e6a2\") " pod="openshift-insights/insights-operator-5c847dcfc4-vsz75" Jul 06 21:08:31.494047 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.494031 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rf8g\" (UniqueName: \"kubernetes.io/projected/f34a6f22-ec93-487d-92c1-b878b40f217e-kube-api-access-9rf8g\") pod \"cluster-monitoring-operator-64786d9cbb-hcx9k\" (UID: \"f34a6f22-ec93-487d-92c1-b878b40f217e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hcx9k" Jul 06 21:08:31.586212 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.586120 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/826404fc-09bb-44da-bd6a-3d071e3009c8-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-vcp8r\" (UID: \"826404fc-09bb-44da-bd6a-3d071e3009c8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vcp8r" Jul 06 21:08:31.586212 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.586182 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7n72\" (UniqueName: \"kubernetes.io/projected/826404fc-09bb-44da-bd6a-3d071e3009c8-kube-api-access-j7n72\") pod \"kube-storage-version-migrator-operator-846bf668f7-vcp8r\" (UID: \"826404fc-09bb-44da-bd6a-3d071e3009c8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vcp8r" Jul 06 21:08:31.586430 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.586269 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/826404fc-09bb-44da-bd6a-3d071e3009c8-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-vcp8r\" (UID: \"826404fc-09bb-44da-bd6a-3d071e3009c8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vcp8r" Jul 06 21:08:31.586796 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.586770 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/826404fc-09bb-44da-bd6a-3d071e3009c8-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-vcp8r\" (UID: \"826404fc-09bb-44da-bd6a-3d071e3009c8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vcp8r" Jul 06 21:08:31.588414 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.588395 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/826404fc-09bb-44da-bd6a-3d071e3009c8-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-vcp8r\" (UID: \"826404fc-09bb-44da-bd6a-3d071e3009c8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vcp8r" Jul 06 21:08:31.595106 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.595083 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7n72\" (UniqueName: \"kubernetes.io/projected/826404fc-09bb-44da-bd6a-3d071e3009c8-kube-api-access-j7n72\") pod \"kube-storage-version-migrator-operator-846bf668f7-vcp8r\" (UID: \"826404fc-09bb-44da-bd6a-3d071e3009c8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vcp8r" Jul 06 21:08:31.641784 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.641757 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-kmj89" Jul 06 21:08:31.647789 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.647768 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-z727m" Jul 06 21:08:31.652595 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.652575 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-vsz75" Jul 06 21:08:31.733507 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.733480 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vcp8r" Jul 06 21:08:31.786833 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.786756 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-kmj89"] Jul 06 21:08:31.790534 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:08:31.790504 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f61871c_5112_4899_b3f7_4c88752b416f.slice/crio-10c743b844ed2adeda4453eb82b29c1156ed623d56f0bd116433626dd29069e9 WatchSource:0}: Error finding container 10c743b844ed2adeda4453eb82b29c1156ed623d56f0bd116433626dd29069e9: Status 404 returned error can't find the container with id 10c743b844ed2adeda4453eb82b29c1156ed623d56f0bd116433626dd29069e9 Jul 06 21:08:31.816542 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.816512 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-kmj89" event={"ID":"1f61871c-5112-4899-b3f7-4c88752b416f","Type":"ContainerStarted","Data":"10c743b844ed2adeda4453eb82b29c1156ed623d56f0bd116433626dd29069e9"} Jul 06 21:08:31.866251 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.866223 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vcp8r"] Jul 06 21:08:31.868404 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:08:31.868380 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod826404fc_09bb_44da_bd6a_3d071e3009c8.slice/crio-3dd10c4f494854a66ad50933da3c954c197cb55b170897942abbd796295e9b6d WatchSource:0}: Error finding container 3dd10c4f494854a66ad50933da3c954c197cb55b170897942abbd796295e9b6d: Status 404 returned error can't find the container with id 3dd10c4f494854a66ad50933da3c954c197cb55b170897942abbd796295e9b6d Jul 06 21:08:31.991341 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:31.991280 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f34a6f22-ec93-487d-92c1-b878b40f217e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-hcx9k\" (UID: \"f34a6f22-ec93-487d-92c1-b878b40f217e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hcx9k" Jul 06 21:08:31.991528 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:08:31.991413 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 21:08:31.991528 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:08:31.991474 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f34a6f22-ec93-487d-92c1-b878b40f217e-cluster-monitoring-operator-tls podName:f34a6f22-ec93-487d-92c1-b878b40f217e nodeName:}" failed. No retries permitted until 2026-07-06 21:08:32.991460131 +0000 UTC m=+259.509698264 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f34a6f22-ec93-487d-92c1-b878b40f217e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-hcx9k" (UID: "f34a6f22-ec93-487d-92c1-b878b40f217e") : secret "cluster-monitoring-operator-tls" not found Jul 06 21:08:32.014226 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:32.014204 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-z727m"] Jul 06 21:08:32.016717 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:08:32.016689 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8331c1e_5061_4874_9338_e9daf1c79b83.slice/crio-6b3057e3692cba372abc40f175a106faa716522d2e14d297a39294440d4a22c6 WatchSource:0}: Error finding container 6b3057e3692cba372abc40f175a106faa716522d2e14d297a39294440d4a22c6: Status 404 returned error can't find the container with id 6b3057e3692cba372abc40f175a106faa716522d2e14d297a39294440d4a22c6 Jul 06 21:08:32.016813 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:32.016769 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-vsz75"] Jul 06 21:08:32.018804 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:08:32.018763 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6c752c6_9cfb_4761_b7ce_ca3e2d37e6a2.slice/crio-7fb0d07f32bd989fe574a2c73eea49e9e4a1e5e569de7c3ad2fc19a14bd3240f WatchSource:0}: Error finding container 7fb0d07f32bd989fe574a2c73eea49e9e4a1e5e569de7c3ad2fc19a14bd3240f: Status 404 returned error can't find the container with id 7fb0d07f32bd989fe574a2c73eea49e9e4a1e5e569de7c3ad2fc19a14bd3240f Jul 06 21:08:32.822297 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:32.822256 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vcp8r" event={"ID":"826404fc-09bb-44da-bd6a-3d071e3009c8","Type":"ContainerStarted","Data":"3dd10c4f494854a66ad50933da3c954c197cb55b170897942abbd796295e9b6d"} Jul 06 21:08:32.824148 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:32.824073 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-z727m" event={"ID":"d8331c1e-5061-4874-9338-e9daf1c79b83","Type":"ContainerStarted","Data":"6b3057e3692cba372abc40f175a106faa716522d2e14d297a39294440d4a22c6"} Jul 06 21:08:32.825788 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:32.825739 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-vsz75" event={"ID":"e6c752c6-9cfb-4761-b7ce-ca3e2d37e6a2","Type":"ContainerStarted","Data":"7fb0d07f32bd989fe574a2c73eea49e9e4a1e5e569de7c3ad2fc19a14bd3240f"} Jul 06 21:08:33.001078 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:33.000801 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f34a6f22-ec93-487d-92c1-b878b40f217e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-hcx9k\" (UID: \"f34a6f22-ec93-487d-92c1-b878b40f217e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hcx9k" Jul 06 21:08:33.001078 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:08:33.001026 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 21:08:33.001307 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:08:33.001096 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f34a6f22-ec93-487d-92c1-b878b40f217e-cluster-monitoring-operator-tls podName:f34a6f22-ec93-487d-92c1-b878b40f217e nodeName:}" failed. No retries permitted until 2026-07-06 21:08:35.001078302 +0000 UTC m=+261.519316439 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f34a6f22-ec93-487d-92c1-b878b40f217e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-hcx9k" (UID: "f34a6f22-ec93-487d-92c1-b878b40f217e") : secret "cluster-monitoring-operator-tls" not found Jul 06 21:08:33.830490 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:33.830450 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-kmj89" event={"ID":"1f61871c-5112-4899-b3f7-4c88752b416f","Type":"ContainerStarted","Data":"ff8082309445824c6acfd976b47132ea2f44cd3444cdf44d87694ca27d8ecf72"} Jul 06 21:08:33.846140 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:33.846094 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-kmj89" podStartSLOduration=1.461891182 podStartE2EDuration="2.846077079s" totalImagesPullingTime="1.384185897s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:08:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:08:33.844952688 +0000 UTC m=+260.363190856" watchObservedRunningTime="2026-07-06 21:08:33.846077079 +0000 UTC m=+260.364315211" Jul 06 21:08:35.019385 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:35.019343 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f34a6f22-ec93-487d-92c1-b878b40f217e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-hcx9k\" (UID: \"f34a6f22-ec93-487d-92c1-b878b40f217e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hcx9k" Jul 06 21:08:35.019789 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:08:35.019480 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 21:08:35.019789 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:08:35.019554 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f34a6f22-ec93-487d-92c1-b878b40f217e-cluster-monitoring-operator-tls podName:f34a6f22-ec93-487d-92c1-b878b40f217e nodeName:}" failed. No retries permitted until 2026-07-06 21:08:39.019535621 +0000 UTC m=+265.537773734 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f34a6f22-ec93-487d-92c1-b878b40f217e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-hcx9k" (UID: "f34a6f22-ec93-487d-92c1-b878b40f217e") : secret "cluster-monitoring-operator-tls" not found Jul 06 21:08:35.840451 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:35.840353 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-vsz75" event={"ID":"e6c752c6-9cfb-4761-b7ce-ca3e2d37e6a2","Type":"ContainerStarted","Data":"2ea735230de7dcc8f31b407bc45b3dc061094e3f08dcb0f89595ea06d56e7fec"} Jul 06 21:08:35.842048 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:35.841973 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vcp8r" event={"ID":"826404fc-09bb-44da-bd6a-3d071e3009c8","Type":"ContainerStarted","Data":"cde793ecee86dec405c4dec0d132d7692bc51e2f281402622758cd0aaf1611d7"} Jul 06 21:08:35.843969 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:35.843942 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-z727m" event={"ID":"d8331c1e-5061-4874-9338-e9daf1c79b83","Type":"ContainerStarted","Data":"a9ba3e2afd8ab7c5b187fb7e2425252f2c0d3efee9794560ca6c71fc3529acdc"} Jul 06 21:08:35.855878 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:35.855834 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-vsz75" podStartSLOduration=1.418719581 podStartE2EDuration="4.855816945s" totalImagesPullingTime="3.437097364s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:08:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:08:35.85553331 +0000 UTC m=+262.373771443" watchObservedRunningTime="2026-07-06 21:08:35.855816945 +0000 UTC m=+262.374055078" Jul 06 21:08:35.870332 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:35.870261 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vcp8r" podStartSLOduration=1.284759432 podStartE2EDuration="4.8702425s" totalImagesPullingTime="3.585483068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:08:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:08:35.870067139 +0000 UTC m=+262.388305299" watchObservedRunningTime="2026-07-06 21:08:35.8702425 +0000 UTC m=+262.388480633" Jul 06 21:08:35.885051 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:35.884999 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-z727m" podStartSLOduration=1.4419568759999999 podStartE2EDuration="4.884981364s" totalImagesPullingTime="3.443024488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:08:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:08:35.884621121 +0000 UTC m=+262.402859288" watchObservedRunningTime="2026-07-06 21:08:35.884981364 +0000 UTC m=+262.403219524" Jul 06 21:08:36.585688 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:36.585606 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-zqbsb"] Jul 06 21:08:36.588756 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:36.588732 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-zqbsb" Jul 06 21:08:36.591194 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:36.591167 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 06 21:08:36.591421 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:36.591407 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 06 21:08:36.593551 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:36.593537 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-rf5hq\"" Jul 06 21:08:36.596934 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:36.596909 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-zqbsb"] Jul 06 21:08:36.636530 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:36.636491 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnndf\" (UniqueName: \"kubernetes.io/projected/8ef7addd-b3d3-4a55-861e-f16bf7a3fb8a-kube-api-access-dnndf\") pod \"migrator-d57d58cc9-zqbsb\" (UID: \"8ef7addd-b3d3-4a55-861e-f16bf7a3fb8a\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-zqbsb" Jul 06 21:08:36.737004 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:36.736969 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnndf\" (UniqueName: \"kubernetes.io/projected/8ef7addd-b3d3-4a55-861e-f16bf7a3fb8a-kube-api-access-dnndf\") pod \"migrator-d57d58cc9-zqbsb\" (UID: \"8ef7addd-b3d3-4a55-861e-f16bf7a3fb8a\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-zqbsb" Jul 06 21:08:36.746694 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:36.746573 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnndf\" (UniqueName: \"kubernetes.io/projected/8ef7addd-b3d3-4a55-861e-f16bf7a3fb8a-kube-api-access-dnndf\") pod \"migrator-d57d58cc9-zqbsb\" (UID: \"8ef7addd-b3d3-4a55-861e-f16bf7a3fb8a\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-zqbsb" Jul 06 21:08:36.900085 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:36.900038 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-zqbsb" Jul 06 21:08:36.942690 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:36.942655 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-x54fd"] Jul 06 21:08:36.946485 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:36.946460 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x54fd" Jul 06 21:08:36.949536 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:36.949176 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 21:08:36.949659 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:36.949568 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 21:08:36.949877 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:36.949854 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-s5hgc\"" Jul 06 21:08:36.958948 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:36.958922 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x54fd"] Jul 06 21:08:37.040225 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:37.040193 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0c22c270-f12e-4853-99a7-1e2d46504221-crio-socket\") pod \"insights-runtime-extractor-x54fd\" (UID: \"0c22c270-f12e-4853-99a7-1e2d46504221\") " pod="openshift-insights/insights-runtime-extractor-x54fd" Jul 06 21:08:37.040425 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:37.040300 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0c22c270-f12e-4853-99a7-1e2d46504221-data-volume\") pod \"insights-runtime-extractor-x54fd\" (UID: \"0c22c270-f12e-4853-99a7-1e2d46504221\") " pod="openshift-insights/insights-runtime-extractor-x54fd" Jul 06 21:08:37.040425 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:37.040350 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbpfq\" (UniqueName: \"kubernetes.io/projected/0c22c270-f12e-4853-99a7-1e2d46504221-kube-api-access-zbpfq\") pod \"insights-runtime-extractor-x54fd\" (UID: \"0c22c270-f12e-4853-99a7-1e2d46504221\") " pod="openshift-insights/insights-runtime-extractor-x54fd" Jul 06 21:08:37.040544 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:37.040445 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0c22c270-f12e-4853-99a7-1e2d46504221-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x54fd\" (UID: \"0c22c270-f12e-4853-99a7-1e2d46504221\") " pod="openshift-insights/insights-runtime-extractor-x54fd" Jul 06 21:08:37.040786 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:37.040758 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0c22c270-f12e-4853-99a7-1e2d46504221-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x54fd\" (UID: \"0c22c270-f12e-4853-99a7-1e2d46504221\") " pod="openshift-insights/insights-runtime-extractor-x54fd" Jul 06 21:08:37.041799 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:37.041776 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-zqbsb"] Jul 06 21:08:37.044797 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:08:37.044775 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ef7addd_b3d3_4a55_861e_f16bf7a3fb8a.slice/crio-0293618580f0cf9bc966071decadcef5f3160ee64fdc6866fc0c719a922a1526 WatchSource:0}: Error finding container 0293618580f0cf9bc966071decadcef5f3160ee64fdc6866fc0c719a922a1526: Status 404 returned error can't find the container with id 0293618580f0cf9bc966071decadcef5f3160ee64fdc6866fc0c719a922a1526 Jul 06 21:08:37.141720 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:37.141684 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0c22c270-f12e-4853-99a7-1e2d46504221-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x54fd\" (UID: \"0c22c270-f12e-4853-99a7-1e2d46504221\") " pod="openshift-insights/insights-runtime-extractor-x54fd" Jul 06 21:08:37.141915 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:37.141779 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0c22c270-f12e-4853-99a7-1e2d46504221-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x54fd\" (UID: \"0c22c270-f12e-4853-99a7-1e2d46504221\") " pod="openshift-insights/insights-runtime-extractor-x54fd" Jul 06 21:08:37.141915 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:08:37.141807 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 21:08:37.141915 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:37.141826 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0c22c270-f12e-4853-99a7-1e2d46504221-crio-socket\") pod \"insights-runtime-extractor-x54fd\" (UID: \"0c22c270-f12e-4853-99a7-1e2d46504221\") " pod="openshift-insights/insights-runtime-extractor-x54fd" Jul 06 21:08:37.141915 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:37.141859 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0c22c270-f12e-4853-99a7-1e2d46504221-data-volume\") pod \"insights-runtime-extractor-x54fd\" (UID: \"0c22c270-f12e-4853-99a7-1e2d46504221\") " pod="openshift-insights/insights-runtime-extractor-x54fd" Jul 06 21:08:37.141915 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:08:37.141901 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0c22c270-f12e-4853-99a7-1e2d46504221-kube-rbac-proxy-cm podName:0c22c270-f12e-4853-99a7-1e2d46504221 nodeName:}" failed. No retries permitted until 2026-07-06 21:08:37.641882418 +0000 UTC m=+264.160120541 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0c22c270-f12e-4853-99a7-1e2d46504221-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x54fd" (UID: "0c22c270-f12e-4853-99a7-1e2d46504221") : configmap "kube-rbac-proxy" not found Jul 06 21:08:37.142167 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:37.141916 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbpfq\" (UniqueName: \"kubernetes.io/projected/0c22c270-f12e-4853-99a7-1e2d46504221-kube-api-access-zbpfq\") pod \"insights-runtime-extractor-x54fd\" (UID: \"0c22c270-f12e-4853-99a7-1e2d46504221\") " pod="openshift-insights/insights-runtime-extractor-x54fd" Jul 06 21:08:37.142167 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:08:37.141928 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 21:08:37.142167 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:08:37.141986 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c22c270-f12e-4853-99a7-1e2d46504221-insights-runtime-extractor-tls podName:0c22c270-f12e-4853-99a7-1e2d46504221 nodeName:}" failed. No retries permitted until 2026-07-06 21:08:37.641969494 +0000 UTC m=+264.160207621 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0c22c270-f12e-4853-99a7-1e2d46504221-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x54fd" (UID: "0c22c270-f12e-4853-99a7-1e2d46504221") : secret "insights-runtime-extractor-tls" not found Jul 06 21:08:37.142167 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:37.142001 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0c22c270-f12e-4853-99a7-1e2d46504221-crio-socket\") pod \"insights-runtime-extractor-x54fd\" (UID: \"0c22c270-f12e-4853-99a7-1e2d46504221\") " pod="openshift-insights/insights-runtime-extractor-x54fd" Jul 06 21:08:37.142345 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:37.142216 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0c22c270-f12e-4853-99a7-1e2d46504221-data-volume\") pod \"insights-runtime-extractor-x54fd\" (UID: \"0c22c270-f12e-4853-99a7-1e2d46504221\") " pod="openshift-insights/insights-runtime-extractor-x54fd" Jul 06 21:08:37.149628 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:37.149603 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbpfq\" (UniqueName: \"kubernetes.io/projected/0c22c270-f12e-4853-99a7-1e2d46504221-kube-api-access-zbpfq\") pod \"insights-runtime-extractor-x54fd\" (UID: \"0c22c270-f12e-4853-99a7-1e2d46504221\") " pod="openshift-insights/insights-runtime-extractor-x54fd" Jul 06 21:08:37.644871 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:37.644815 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0c22c270-f12e-4853-99a7-1e2d46504221-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x54fd\" (UID: \"0c22c270-f12e-4853-99a7-1e2d46504221\") " pod="openshift-insights/insights-runtime-extractor-x54fd" Jul 06 21:08:37.645344 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:37.644912 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0c22c270-f12e-4853-99a7-1e2d46504221-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x54fd\" (UID: \"0c22c270-f12e-4853-99a7-1e2d46504221\") " pod="openshift-insights/insights-runtime-extractor-x54fd" Jul 06 21:08:37.645344 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:08:37.644984 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 21:08:37.645344 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:08:37.645006 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 21:08:37.645344 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:08:37.645051 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c22c270-f12e-4853-99a7-1e2d46504221-insights-runtime-extractor-tls podName:0c22c270-f12e-4853-99a7-1e2d46504221 nodeName:}" failed. No retries permitted until 2026-07-06 21:08:38.645037997 +0000 UTC m=+265.163276107 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0c22c270-f12e-4853-99a7-1e2d46504221-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x54fd" (UID: "0c22c270-f12e-4853-99a7-1e2d46504221") : secret "insights-runtime-extractor-tls" not found Jul 06 21:08:37.645344 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:08:37.645076 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0c22c270-f12e-4853-99a7-1e2d46504221-kube-rbac-proxy-cm podName:0c22c270-f12e-4853-99a7-1e2d46504221 nodeName:}" failed. No retries permitted until 2026-07-06 21:08:38.645055425 +0000 UTC m=+265.163293536 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0c22c270-f12e-4853-99a7-1e2d46504221-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x54fd" (UID: "0c22c270-f12e-4853-99a7-1e2d46504221") : configmap "kube-rbac-proxy" not found Jul 06 21:08:37.851557 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:37.851517 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-zqbsb" event={"ID":"8ef7addd-b3d3-4a55-861e-f16bf7a3fb8a","Type":"ContainerStarted","Data":"0293618580f0cf9bc966071decadcef5f3160ee64fdc6866fc0c719a922a1526"} Jul 06 21:08:38.654145 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:38.654116 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0c22c270-f12e-4853-99a7-1e2d46504221-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x54fd\" (UID: \"0c22c270-f12e-4853-99a7-1e2d46504221\") " pod="openshift-insights/insights-runtime-extractor-x54fd" Jul 06 21:08:38.654490 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:08:38.654228 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 21:08:38.654490 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:08:38.654283 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0c22c270-f12e-4853-99a7-1e2d46504221-kube-rbac-proxy-cm podName:0c22c270-f12e-4853-99a7-1e2d46504221 nodeName:}" failed. No retries permitted until 2026-07-06 21:08:40.654269096 +0000 UTC m=+267.172507205 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0c22c270-f12e-4853-99a7-1e2d46504221-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x54fd" (UID: "0c22c270-f12e-4853-99a7-1e2d46504221") : configmap "kube-rbac-proxy" not found Jul 06 21:08:38.654490 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:38.654227 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0c22c270-f12e-4853-99a7-1e2d46504221-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x54fd\" (UID: \"0c22c270-f12e-4853-99a7-1e2d46504221\") " pod="openshift-insights/insights-runtime-extractor-x54fd" Jul 06 21:08:38.654490 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:08:38.654341 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 21:08:38.654490 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:08:38.654400 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c22c270-f12e-4853-99a7-1e2d46504221-insights-runtime-extractor-tls podName:0c22c270-f12e-4853-99a7-1e2d46504221 nodeName:}" failed. No retries permitted until 2026-07-06 21:08:40.654384414 +0000 UTC m=+267.172622526 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0c22c270-f12e-4853-99a7-1e2d46504221-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x54fd" (UID: "0c22c270-f12e-4853-99a7-1e2d46504221") : secret "insights-runtime-extractor-tls" not found Jul 06 21:08:38.856192 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:38.856150 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-zqbsb" event={"ID":"8ef7addd-b3d3-4a55-861e-f16bf7a3fb8a","Type":"ContainerStarted","Data":"06bd65bfbda0ff627362648a90c75e12c9817fa29aa4abf478cbd153d8a83a5d"} Jul 06 21:08:38.856395 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:38.856212 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-zqbsb" event={"ID":"8ef7addd-b3d3-4a55-861e-f16bf7a3fb8a","Type":"ContainerStarted","Data":"4c1b30ed4b56efd22470be883b80ecedfb8408511c6bb44e853a3f0fb68b43cd"} Jul 06 21:08:38.871062 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:38.871014 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-zqbsb" podStartSLOduration=1.304869604 podStartE2EDuration="2.870998248s" totalImagesPullingTime="1.566128644s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:08:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:08:38.870266953 +0000 UTC m=+265.388505086" watchObservedRunningTime="2026-07-06 21:08:38.870998248 +0000 UTC m=+265.389236380" Jul 06 21:08:38.915052 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:38.915016 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-nctmn"] Jul 06 21:08:38.918114 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:38.918094 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-nctmn" Jul 06 21:08:38.921452 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:38.921431 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-f6cnz\"" Jul 06 21:08:38.921673 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:38.921659 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 06 21:08:38.921954 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:38.921935 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 06 21:08:38.922047 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:38.922028 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 06 21:08:38.922110 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:38.922030 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 06 21:08:38.927390 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:38.927369 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-nctmn"] Jul 06 21:08:38.956709 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:38.956674 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7292a65b-f336-4541-a96e-cadfb1a0cd6c-signing-key\") pod \"service-ca-758f599c5-nctmn\" (UID: \"7292a65b-f336-4541-a96e-cadfb1a0cd6c\") " pod="openshift-service-ca/service-ca-758f599c5-nctmn" Jul 06 21:08:38.956822 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:38.956745 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwswh\" (UniqueName: \"kubernetes.io/projected/7292a65b-f336-4541-a96e-cadfb1a0cd6c-kube-api-access-pwswh\") pod \"service-ca-758f599c5-nctmn\" (UID: \"7292a65b-f336-4541-a96e-cadfb1a0cd6c\") " pod="openshift-service-ca/service-ca-758f599c5-nctmn" Jul 06 21:08:38.956861 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:38.956821 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7292a65b-f336-4541-a96e-cadfb1a0cd6c-signing-cabundle\") pod \"service-ca-758f599c5-nctmn\" (UID: \"7292a65b-f336-4541-a96e-cadfb1a0cd6c\") " pod="openshift-service-ca/service-ca-758f599c5-nctmn" Jul 06 21:08:39.057843 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:39.057812 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7292a65b-f336-4541-a96e-cadfb1a0cd6c-signing-key\") pod \"service-ca-758f599c5-nctmn\" (UID: \"7292a65b-f336-4541-a96e-cadfb1a0cd6c\") " pod="openshift-service-ca/service-ca-758f599c5-nctmn" Jul 06 21:08:39.058036 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:39.057871 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwswh\" (UniqueName: \"kubernetes.io/projected/7292a65b-f336-4541-a96e-cadfb1a0cd6c-kube-api-access-pwswh\") pod \"service-ca-758f599c5-nctmn\" (UID: \"7292a65b-f336-4541-a96e-cadfb1a0cd6c\") " pod="openshift-service-ca/service-ca-758f599c5-nctmn" Jul 06 21:08:39.058036 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:39.057902 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7292a65b-f336-4541-a96e-cadfb1a0cd6c-signing-cabundle\") pod \"service-ca-758f599c5-nctmn\" (UID: \"7292a65b-f336-4541-a96e-cadfb1a0cd6c\") " pod="openshift-service-ca/service-ca-758f599c5-nctmn" Jul 06 21:08:39.058036 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:39.057937 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f34a6f22-ec93-487d-92c1-b878b40f217e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-hcx9k\" (UID: \"f34a6f22-ec93-487d-92c1-b878b40f217e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hcx9k" Jul 06 21:08:39.058196 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:08:39.058052 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 21:08:39.058196 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:08:39.058118 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f34a6f22-ec93-487d-92c1-b878b40f217e-cluster-monitoring-operator-tls podName:f34a6f22-ec93-487d-92c1-b878b40f217e nodeName:}" failed. No retries permitted until 2026-07-06 21:08:47.058099868 +0000 UTC m=+273.576337978 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f34a6f22-ec93-487d-92c1-b878b40f217e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-hcx9k" (UID: "f34a6f22-ec93-487d-92c1-b878b40f217e") : secret "cluster-monitoring-operator-tls" not found Jul 06 21:08:39.058656 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:39.058635 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7292a65b-f336-4541-a96e-cadfb1a0cd6c-signing-cabundle\") pod \"service-ca-758f599c5-nctmn\" (UID: \"7292a65b-f336-4541-a96e-cadfb1a0cd6c\") " pod="openshift-service-ca/service-ca-758f599c5-nctmn" Jul 06 21:08:39.060228 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:39.060212 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7292a65b-f336-4541-a96e-cadfb1a0cd6c-signing-key\") pod \"service-ca-758f599c5-nctmn\" (UID: \"7292a65b-f336-4541-a96e-cadfb1a0cd6c\") " pod="openshift-service-ca/service-ca-758f599c5-nctmn" Jul 06 21:08:39.066275 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:39.066255 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwswh\" (UniqueName: \"kubernetes.io/projected/7292a65b-f336-4541-a96e-cadfb1a0cd6c-kube-api-access-pwswh\") pod \"service-ca-758f599c5-nctmn\" (UID: \"7292a65b-f336-4541-a96e-cadfb1a0cd6c\") " pod="openshift-service-ca/service-ca-758f599c5-nctmn" Jul 06 21:08:39.227126 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:39.227034 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-nctmn" Jul 06 21:08:39.345442 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:39.345409 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-nctmn"] Jul 06 21:08:39.348981 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:08:39.348954 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7292a65b_f336_4541_a96e_cadfb1a0cd6c.slice/crio-65ef7a006eb8ef59a4abbcd77cd26ec981c5ec5aada566cdaf281f7531579316 WatchSource:0}: Error finding container 65ef7a006eb8ef59a4abbcd77cd26ec981c5ec5aada566cdaf281f7531579316: Status 404 returned error can't find the container with id 65ef7a006eb8ef59a4abbcd77cd26ec981c5ec5aada566cdaf281f7531579316 Jul 06 21:08:39.860919 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:39.860870 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-nctmn" event={"ID":"7292a65b-f336-4541-a96e-cadfb1a0cd6c","Type":"ContainerStarted","Data":"46e2c425e486e0eb66c82590203681100a57516b4f1bb6ef6c0f79a429a9832f"} Jul 06 21:08:39.861387 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:39.860966 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-nctmn" event={"ID":"7292a65b-f336-4541-a96e-cadfb1a0cd6c","Type":"ContainerStarted","Data":"65ef7a006eb8ef59a4abbcd77cd26ec981c5ec5aada566cdaf281f7531579316"} Jul 06 21:08:39.884445 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:39.884398 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-nctmn" podStartSLOduration=1.884382218 podStartE2EDuration="1.884382218s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:08:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:08:39.883635149 +0000 UTC m=+266.401873309" watchObservedRunningTime="2026-07-06 21:08:39.884382218 +0000 UTC m=+266.402620350" Jul 06 21:08:39.936359 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:39.936329 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zhhvw_34abb9cb-886c-4133-b204-c5c02d6dbdf6/dns-node-resolver/0.log" Jul 06 21:08:40.533392 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:40.533365 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-28sv5_a7028afb-6989-4fe8-a9a6-1230b13b505e/node-ca/0.log" Jul 06 21:08:40.671837 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:40.671805 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0c22c270-f12e-4853-99a7-1e2d46504221-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x54fd\" (UID: \"0c22c270-f12e-4853-99a7-1e2d46504221\") " pod="openshift-insights/insights-runtime-extractor-x54fd" Jul 06 21:08:40.672009 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:40.671871 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0c22c270-f12e-4853-99a7-1e2d46504221-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x54fd\" (UID: \"0c22c270-f12e-4853-99a7-1e2d46504221\") " pod="openshift-insights/insights-runtime-extractor-x54fd" Jul 06 21:08:40.672009 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:08:40.671942 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 21:08:40.672009 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:08:40.672003 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 21:08:40.672180 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:08:40.672019 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0c22c270-f12e-4853-99a7-1e2d46504221-kube-rbac-proxy-cm podName:0c22c270-f12e-4853-99a7-1e2d46504221 nodeName:}" failed. No retries permitted until 2026-07-06 21:08:44.671999099 +0000 UTC m=+271.190237210 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0c22c270-f12e-4853-99a7-1e2d46504221-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x54fd" (UID: "0c22c270-f12e-4853-99a7-1e2d46504221") : configmap "kube-rbac-proxy" not found Jul 06 21:08:40.672180 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:08:40.672043 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c22c270-f12e-4853-99a7-1e2d46504221-insights-runtime-extractor-tls podName:0c22c270-f12e-4853-99a7-1e2d46504221 nodeName:}" failed. No retries permitted until 2026-07-06 21:08:44.672031825 +0000 UTC m=+271.190269960 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0c22c270-f12e-4853-99a7-1e2d46504221-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x54fd" (UID: "0c22c270-f12e-4853-99a7-1e2d46504221") : secret "insights-runtime-extractor-tls" not found Jul 06 21:08:41.533166 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:41.533135 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-k5tm2_22c46544-3b08-4ad7-8f17-8a1210bf99b4/serve-healthcheck-canary/0.log" Jul 06 21:08:41.933142 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:41.933111 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-zqbsb_8ef7addd-b3d3-4a55-861e-f16bf7a3fb8a/migrator/0.log" Jul 06 21:08:42.133111 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:42.133078 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-zqbsb_8ef7addd-b3d3-4a55-861e-f16bf7a3fb8a/graceful-termination/0.log" Jul 06 21:08:42.333999 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:42.333908 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-vcp8r_826404fc-09bb-44da-bd6a-3d071e3009c8/kube-storage-version-migrator-operator/0.log" Jul 06 21:08:44.706569 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:44.706526 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0c22c270-f12e-4853-99a7-1e2d46504221-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x54fd\" (UID: \"0c22c270-f12e-4853-99a7-1e2d46504221\") " pod="openshift-insights/insights-runtime-extractor-x54fd" Jul 06 21:08:44.706949 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:44.706612 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0c22c270-f12e-4853-99a7-1e2d46504221-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x54fd\" (UID: \"0c22c270-f12e-4853-99a7-1e2d46504221\") " pod="openshift-insights/insights-runtime-extractor-x54fd" Jul 06 21:08:44.706949 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:08:44.706686 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 21:08:44.706949 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:08:44.706697 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 21:08:44.706949 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:08:44.706739 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0c22c270-f12e-4853-99a7-1e2d46504221-kube-rbac-proxy-cm podName:0c22c270-f12e-4853-99a7-1e2d46504221 nodeName:}" failed. No retries permitted until 2026-07-06 21:08:52.706725999 +0000 UTC m=+279.224964109 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0c22c270-f12e-4853-99a7-1e2d46504221-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x54fd" (UID: "0c22c270-f12e-4853-99a7-1e2d46504221") : configmap "kube-rbac-proxy" not found Jul 06 21:08:44.706949 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:08:44.706762 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c22c270-f12e-4853-99a7-1e2d46504221-insights-runtime-extractor-tls podName:0c22c270-f12e-4853-99a7-1e2d46504221 nodeName:}" failed. No retries permitted until 2026-07-06 21:08:52.706747063 +0000 UTC m=+279.224985190 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0c22c270-f12e-4853-99a7-1e2d46504221-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x54fd" (UID: "0c22c270-f12e-4853-99a7-1e2d46504221") : secret "insights-runtime-extractor-tls" not found Jul 06 21:08:47.126814 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:47.126776 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f34a6f22-ec93-487d-92c1-b878b40f217e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-hcx9k\" (UID: \"f34a6f22-ec93-487d-92c1-b878b40f217e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hcx9k" Jul 06 21:08:47.127208 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:08:47.126909 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 21:08:47.127208 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:08:47.126962 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f34a6f22-ec93-487d-92c1-b878b40f217e-cluster-monitoring-operator-tls podName:f34a6f22-ec93-487d-92c1-b878b40f217e nodeName:}" failed. No retries permitted until 2026-07-06 21:09:03.126949114 +0000 UTC m=+289.645187223 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f34a6f22-ec93-487d-92c1-b878b40f217e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-hcx9k" (UID: "f34a6f22-ec93-487d-92c1-b878b40f217e") : secret "cluster-monitoring-operator-tls" not found Jul 06 21:08:52.775819 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:52.775771 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0c22c270-f12e-4853-99a7-1e2d46504221-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x54fd\" (UID: \"0c22c270-f12e-4853-99a7-1e2d46504221\") " pod="openshift-insights/insights-runtime-extractor-x54fd" Jul 06 21:08:52.776337 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:52.775886 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0c22c270-f12e-4853-99a7-1e2d46504221-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x54fd\" (UID: \"0c22c270-f12e-4853-99a7-1e2d46504221\") " pod="openshift-insights/insights-runtime-extractor-x54fd" Jul 06 21:08:52.776438 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:52.776417 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0c22c270-f12e-4853-99a7-1e2d46504221-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x54fd\" (UID: \"0c22c270-f12e-4853-99a7-1e2d46504221\") " pod="openshift-insights/insights-runtime-extractor-x54fd" Jul 06 21:08:52.778109 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:52.778089 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0c22c270-f12e-4853-99a7-1e2d46504221-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x54fd\" (UID: \"0c22c270-f12e-4853-99a7-1e2d46504221\") " pod="openshift-insights/insights-runtime-extractor-x54fd" Jul 06 21:08:52.859486 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:52.859449 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x54fd" Jul 06 21:08:53.010864 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:53.010837 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x54fd"] Jul 06 21:08:53.012105 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:08:53.012077 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c22c270_f12e_4853_99a7_1e2d46504221.slice/crio-d5e4aab188dd4e7e8107405087eaebafcd82ff6ebffd82d7a3243b68af390199 WatchSource:0}: Error finding container d5e4aab188dd4e7e8107405087eaebafcd82ff6ebffd82d7a3243b68af390199: Status 404 returned error can't find the container with id d5e4aab188dd4e7e8107405087eaebafcd82ff6ebffd82d7a3243b68af390199 Jul 06 21:08:53.910728 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:53.910684 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x54fd" event={"ID":"0c22c270-f12e-4853-99a7-1e2d46504221","Type":"ContainerStarted","Data":"d5e4aab188dd4e7e8107405087eaebafcd82ff6ebffd82d7a3243b68af390199"} Jul 06 21:08:56.594028 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:08:56.593982 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6bffdf9778-f29qt" podUID="1867e5c6-1cdc-4302-b705-5c7cd807677b" Jul 06 21:08:56.594028 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:08:56.593982 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-65d484654d-d45tf" podUID="21e6ad8b-efe9-4faf-a400-e1014c3dfbb5" Jul 06 21:08:56.594028 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:08:56.593982 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-pftrl" podUID="05fbf402-3b73-4ed1-a153-4e3367a41518" Jul 06 21:08:56.921227 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:56.921192 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pftrl" Jul 06 21:08:56.921381 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:56.921192 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-f29qt" Jul 06 21:08:56.921381 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:56.921191 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65d484654d-d45tf" Jul 06 21:08:57.925796 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:57.925755 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x54fd" event={"ID":"0c22c270-f12e-4853-99a7-1e2d46504221","Type":"ContainerStarted","Data":"4a5ebadd7f60e2add10de0059fb30b841a9befc581af99d01c2c4b1c980d861e"} Jul 06 21:08:57.926427 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:08:57.925854 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x54fd" event={"ID":"0c22c270-f12e-4853-99a7-1e2d46504221","Type":"ContainerStarted","Data":"07fbcc27cef8073161f48d096bcbb516a6f1052e154ce07ae671025e7a15e481"} Jul 06 21:09:00.340539 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:00.340501 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-registry-tls\") pod \"image-registry-65d484654d-d45tf\" (UID: \"21e6ad8b-efe9-4faf-a400-e1014c3dfbb5\") " pod="openshift-image-registry/image-registry-65d484654d-d45tf" Jul 06 21:09:00.341028 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:00.340567 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05fbf402-3b73-4ed1-a153-4e3367a41518-metrics-tls\") pod \"dns-default-pftrl\" (UID: \"05fbf402-3b73-4ed1-a153-4e3367a41518\") " pod="openshift-dns/dns-default-pftrl" Jul 06 21:09:00.341028 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:00.340661 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1867e5c6-1cdc-4302-b705-5c7cd807677b-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-f29qt\" (UID: \"1867e5c6-1cdc-4302-b705-5c7cd807677b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-f29qt" Jul 06 21:09:00.343070 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:00.343034 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05fbf402-3b73-4ed1-a153-4e3367a41518-metrics-tls\") pod \"dns-default-pftrl\" (UID: \"05fbf402-3b73-4ed1-a153-4e3367a41518\") " pod="openshift-dns/dns-default-pftrl" Jul 06 21:09:00.343182 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:00.343037 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1867e5c6-1cdc-4302-b705-5c7cd807677b-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-f29qt\" (UID: \"1867e5c6-1cdc-4302-b705-5c7cd807677b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-f29qt" Jul 06 21:09:00.343182 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:00.343108 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-registry-tls\") pod \"image-registry-65d484654d-d45tf\" (UID: \"21e6ad8b-efe9-4faf-a400-e1014c3dfbb5\") " pod="openshift-image-registry/image-registry-65d484654d-d45tf" Jul 06 21:09:00.525671 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:00.525633 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-k47bk\"" Jul 06 21:09:00.525862 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:00.525725 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-nbkdt\"" Jul 06 21:09:00.525862 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:00.525788 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gxsch\"" Jul 06 21:09:00.532813 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:00.532794 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65d484654d-d45tf" Jul 06 21:09:00.532928 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:00.532879 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-f29qt" Jul 06 21:09:00.532928 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:00.532900 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pftrl" Jul 06 21:09:00.701352 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:00.701197 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pftrl"] Jul 06 21:09:00.704406 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:09:00.704375 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05fbf402_3b73_4ed1_a153_4e3367a41518.slice/crio-43ae4b20796ab4ea6f9d5c9ca02478a82acd656a09aae40d55b51661a3d64530 WatchSource:0}: Error finding container 43ae4b20796ab4ea6f9d5c9ca02478a82acd656a09aae40d55b51661a3d64530: Status 404 returned error can't find the container with id 43ae4b20796ab4ea6f9d5c9ca02478a82acd656a09aae40d55b51661a3d64530 Jul 06 21:09:00.922750 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:00.922588 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-f29qt"] Jul 06 21:09:00.926148 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:09:00.926115 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1867e5c6_1cdc_4302_b705_5c7cd807677b.slice/crio-7da48fd8af67a91ee1459465598e38577bc6666e73dd89bf4d4ad672c909ebf3 WatchSource:0}: Error finding container 7da48fd8af67a91ee1459465598e38577bc6666e73dd89bf4d4ad672c909ebf3: Status 404 returned error can't find the container with id 7da48fd8af67a91ee1459465598e38577bc6666e73dd89bf4d4ad672c909ebf3 Jul 06 21:09:00.926781 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:00.926757 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65d484654d-d45tf"] Jul 06 21:09:00.929810 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:09:00.929790 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21e6ad8b_efe9_4faf_a400_e1014c3dfbb5.slice/crio-df2eedab27a02d951461f3687694154768577954ccb2c473ecd3b16abbc1f07f WatchSource:0}: Error finding container df2eedab27a02d951461f3687694154768577954ccb2c473ecd3b16abbc1f07f: Status 404 returned error can't find the container with id df2eedab27a02d951461f3687694154768577954ccb2c473ecd3b16abbc1f07f Jul 06 21:09:00.937130 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:00.937093 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pftrl" event={"ID":"05fbf402-3b73-4ed1-a153-4e3367a41518","Type":"ContainerStarted","Data":"43ae4b20796ab4ea6f9d5c9ca02478a82acd656a09aae40d55b51661a3d64530"} Jul 06 21:09:00.938265 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:00.938239 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-f29qt" event={"ID":"1867e5c6-1cdc-4302-b705-5c7cd807677b","Type":"ContainerStarted","Data":"7da48fd8af67a91ee1459465598e38577bc6666e73dd89bf4d4ad672c909ebf3"} Jul 06 21:09:00.940251 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:00.940230 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x54fd" event={"ID":"0c22c270-f12e-4853-99a7-1e2d46504221","Type":"ContainerStarted","Data":"4caf6333987cb5df8b026a3295ad45d101fa994e6b0112643fad34d5719f5285"} Jul 06 21:09:00.941723 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:00.941700 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65d484654d-d45tf" event={"ID":"21e6ad8b-efe9-4faf-a400-e1014c3dfbb5","Type":"ContainerStarted","Data":"df2eedab27a02d951461f3687694154768577954ccb2c473ecd3b16abbc1f07f"} Jul 06 21:09:00.957464 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:00.957424 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-x54fd" podStartSLOduration=18.010617275 podStartE2EDuration="24.957410385s" totalImagesPullingTime="6.94679311s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:08:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:09:00.956704514 +0000 UTC m=+287.474942672" watchObservedRunningTime="2026-07-06 21:09:00.957410385 +0000 UTC m=+287.475648544" Jul 06 21:09:01.947254 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:01.947191 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65d484654d-d45tf" event={"ID":"21e6ad8b-efe9-4faf-a400-e1014c3dfbb5","Type":"ContainerStarted","Data":"7195903071a514d1dbb972b0f4e3141d930045b6834e1525baa366e45e9a1f4b"} Jul 06 21:09:01.947945 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:01.947438 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-65d484654d-d45tf" Jul 06 21:09:01.968484 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:01.968427 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-65d484654d-d45tf" podStartSLOduration=287.968406688 podStartE2EDuration="4m47.968406688s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:04:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:09:01.96703958 +0000 UTC m=+288.485277712" watchObservedRunningTime="2026-07-06 21:09:01.968406688 +0000 UTC m=+288.486644822" Jul 06 21:09:02.952625 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:02.952590 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pftrl" event={"ID":"05fbf402-3b73-4ed1-a153-4e3367a41518","Type":"ContainerStarted","Data":"1a0a4f4f7f86ca7e492a53538e0259d27b5023b8e254b7de127782ca8513f96c"} Jul 06 21:09:02.953090 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:02.952671 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pftrl" event={"ID":"05fbf402-3b73-4ed1-a153-4e3367a41518","Type":"ContainerStarted","Data":"6f2aed5c115c89de7877c5af873350c154538925468ff94ec628b012a9db3c83"} Jul 06 21:09:02.953090 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:02.952694 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-pftrl" Jul 06 21:09:02.954176 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:02.954155 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-f29qt" event={"ID":"1867e5c6-1cdc-4302-b705-5c7cd807677b","Type":"ContainerStarted","Data":"18cec8780c65452383bd23d5bc7634a81478abd173819973241243245a749cb8"} Jul 06 21:09:02.969092 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:02.969034 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-pftrl" podStartSLOduration=250.94276557 podStartE2EDuration="4m12.969017739s" totalImagesPullingTime="2.026252169s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:04:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:09:02.967968873 +0000 UTC m=+289.486207022" watchObservedRunningTime="2026-07-06 21:09:02.969017739 +0000 UTC m=+289.487255871" Jul 06 21:09:02.983501 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:02.983396 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-f29qt" podStartSLOduration=287.183257297 podStartE2EDuration="4m48.983379684s" totalImagesPullingTime="1.800122387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:04:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:09:02.983042535 +0000 UTC m=+289.501280697" watchObservedRunningTime="2026-07-06 21:09:02.983379684 +0000 UTC m=+289.501617815" Jul 06 21:09:03.166943 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:03.166903 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f34a6f22-ec93-487d-92c1-b878b40f217e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-hcx9k\" (UID: \"f34a6f22-ec93-487d-92c1-b878b40f217e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hcx9k" Jul 06 21:09:03.169335 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:03.169294 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f34a6f22-ec93-487d-92c1-b878b40f217e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-hcx9k\" (UID: \"f34a6f22-ec93-487d-92c1-b878b40f217e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hcx9k" Jul 06 21:09:03.436069 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:03.436026 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hcx9k" Jul 06 21:09:03.558855 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:03.558821 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hcx9k"] Jul 06 21:09:03.562198 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:09:03.562152 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf34a6f22_ec93_487d_92c1_b878b40f217e.slice/crio-65e9d01e63c11c9ad84b0c01c785714593c6df95d3ce91d4fb6bdb0cdaaa2481 WatchSource:0}: Error finding container 65e9d01e63c11c9ad84b0c01c785714593c6df95d3ce91d4fb6bdb0cdaaa2481: Status 404 returned error can't find the container with id 65e9d01e63c11c9ad84b0c01c785714593c6df95d3ce91d4fb6bdb0cdaaa2481 Jul 06 21:09:03.958175 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:03.958139 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hcx9k" event={"ID":"f34a6f22-ec93-487d-92c1-b878b40f217e","Type":"ContainerStarted","Data":"65e9d01e63c11c9ad84b0c01c785714593c6df95d3ce91d4fb6bdb0cdaaa2481"} Jul 06 21:09:06.970134 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:06.970098 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hcx9k" event={"ID":"f34a6f22-ec93-487d-92c1-b878b40f217e","Type":"ContainerStarted","Data":"806143226f05896481ee30470f4faa1f2f155a80200c28760c320ef47f81bbd0"} Jul 06 21:09:06.986377 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:06.986331 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hcx9k" podStartSLOduration=33.319851918 podStartE2EDuration="35.98630432s" totalImagesPullingTime="2.666452402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:08:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:09:06.98563666 +0000 UTC m=+293.503874820" watchObservedRunningTime="2026-07-06 21:09:06.98630432 +0000 UTC m=+293.504542452" Jul 06 21:09:12.030349 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:09:12.030298 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-c795j" podUID="084dc07e-e49b-44e3-95cc-11e11c5037a5" Jul 06 21:09:12.441246 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:12.441210 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-846c49bc6f-hq8g2"] Jul 06 21:09:12.444539 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:12.444522 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-846c49bc6f-hq8g2" Jul 06 21:09:12.448079 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:12.448053 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 06 21:09:12.448192 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:12.448061 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 06 21:09:12.448192 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:12.448119 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 06 21:09:12.449144 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:12.449120 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 06 21:09:12.449255 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:12.449232 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 06 21:09:12.449403 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:12.449260 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 06 21:09:12.449403 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:12.449279 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 06 21:09:12.450389 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:12.450363 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-nq8gc\"" Jul 06 21:09:12.453515 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:12.453497 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 06 21:09:12.455799 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:12.455782 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-846c49bc6f-hq8g2"] Jul 06 21:09:12.543953 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:12.543926 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/56589b7e-e251-4b7a-a8e7-48c90ab765ed-oauth-serving-cert\") pod \"console-846c49bc6f-hq8g2\" (UID: \"56589b7e-e251-4b7a-a8e7-48c90ab765ed\") " pod="openshift-console/console-846c49bc6f-hq8g2" Jul 06 21:09:12.544113 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:12.543962 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/56589b7e-e251-4b7a-a8e7-48c90ab765ed-console-config\") pod \"console-846c49bc6f-hq8g2\" (UID: \"56589b7e-e251-4b7a-a8e7-48c90ab765ed\") " pod="openshift-console/console-846c49bc6f-hq8g2" Jul 06 21:09:12.544113 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:12.543985 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56589b7e-e251-4b7a-a8e7-48c90ab765ed-trusted-ca-bundle\") pod \"console-846c49bc6f-hq8g2\" (UID: \"56589b7e-e251-4b7a-a8e7-48c90ab765ed\") " pod="openshift-console/console-846c49bc6f-hq8g2" Jul 06 21:09:12.544113 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:12.544067 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/56589b7e-e251-4b7a-a8e7-48c90ab765ed-console-serving-cert\") pod \"console-846c49bc6f-hq8g2\" (UID: \"56589b7e-e251-4b7a-a8e7-48c90ab765ed\") " pod="openshift-console/console-846c49bc6f-hq8g2" Jul 06 21:09:12.544113 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:12.544096 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/56589b7e-e251-4b7a-a8e7-48c90ab765ed-service-ca\") pod \"console-846c49bc6f-hq8g2\" (UID: \"56589b7e-e251-4b7a-a8e7-48c90ab765ed\") " pod="openshift-console/console-846c49bc6f-hq8g2" Jul 06 21:09:12.544334 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:12.544116 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fl7q\" (UniqueName: \"kubernetes.io/projected/56589b7e-e251-4b7a-a8e7-48c90ab765ed-kube-api-access-9fl7q\") pod \"console-846c49bc6f-hq8g2\" (UID: \"56589b7e-e251-4b7a-a8e7-48c90ab765ed\") " pod="openshift-console/console-846c49bc6f-hq8g2" Jul 06 21:09:12.544334 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:12.544229 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/56589b7e-e251-4b7a-a8e7-48c90ab765ed-console-oauth-config\") pod \"console-846c49bc6f-hq8g2\" (UID: \"56589b7e-e251-4b7a-a8e7-48c90ab765ed\") " pod="openshift-console/console-846c49bc6f-hq8g2" Jul 06 21:09:12.644761 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:12.644731 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/56589b7e-e251-4b7a-a8e7-48c90ab765ed-console-config\") pod \"console-846c49bc6f-hq8g2\" (UID: \"56589b7e-e251-4b7a-a8e7-48c90ab765ed\") " pod="openshift-console/console-846c49bc6f-hq8g2" Jul 06 21:09:12.644850 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:12.644766 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56589b7e-e251-4b7a-a8e7-48c90ab765ed-trusted-ca-bundle\") pod \"console-846c49bc6f-hq8g2\" (UID: \"56589b7e-e251-4b7a-a8e7-48c90ab765ed\") " pod="openshift-console/console-846c49bc6f-hq8g2" Jul 06 21:09:12.644850 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:12.644804 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/56589b7e-e251-4b7a-a8e7-48c90ab765ed-console-serving-cert\") pod \"console-846c49bc6f-hq8g2\" (UID: \"56589b7e-e251-4b7a-a8e7-48c90ab765ed\") " pod="openshift-console/console-846c49bc6f-hq8g2" Jul 06 21:09:12.644850 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:12.644827 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/56589b7e-e251-4b7a-a8e7-48c90ab765ed-service-ca\") pod \"console-846c49bc6f-hq8g2\" (UID: \"56589b7e-e251-4b7a-a8e7-48c90ab765ed\") " pod="openshift-console/console-846c49bc6f-hq8g2" Jul 06 21:09:12.644980 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:12.644850 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fl7q\" (UniqueName: \"kubernetes.io/projected/56589b7e-e251-4b7a-a8e7-48c90ab765ed-kube-api-access-9fl7q\") pod \"console-846c49bc6f-hq8g2\" (UID: \"56589b7e-e251-4b7a-a8e7-48c90ab765ed\") " pod="openshift-console/console-846c49bc6f-hq8g2" Jul 06 21:09:12.644980 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:12.644921 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/56589b7e-e251-4b7a-a8e7-48c90ab765ed-console-oauth-config\") pod \"console-846c49bc6f-hq8g2\" (UID: \"56589b7e-e251-4b7a-a8e7-48c90ab765ed\") " pod="openshift-console/console-846c49bc6f-hq8g2" Jul 06 21:09:12.644980 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:12.644967 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/56589b7e-e251-4b7a-a8e7-48c90ab765ed-oauth-serving-cert\") pod \"console-846c49bc6f-hq8g2\" (UID: \"56589b7e-e251-4b7a-a8e7-48c90ab765ed\") " pod="openshift-console/console-846c49bc6f-hq8g2" Jul 06 21:09:12.645630 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:12.645602 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/56589b7e-e251-4b7a-a8e7-48c90ab765ed-console-config\") pod \"console-846c49bc6f-hq8g2\" (UID: \"56589b7e-e251-4b7a-a8e7-48c90ab765ed\") " pod="openshift-console/console-846c49bc6f-hq8g2" Jul 06 21:09:12.645741 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:12.645666 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/56589b7e-e251-4b7a-a8e7-48c90ab765ed-oauth-serving-cert\") pod \"console-846c49bc6f-hq8g2\" (UID: \"56589b7e-e251-4b7a-a8e7-48c90ab765ed\") " pod="openshift-console/console-846c49bc6f-hq8g2" Jul 06 21:09:12.645741 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:12.645663 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/56589b7e-e251-4b7a-a8e7-48c90ab765ed-service-ca\") pod \"console-846c49bc6f-hq8g2\" (UID: \"56589b7e-e251-4b7a-a8e7-48c90ab765ed\") " pod="openshift-console/console-846c49bc6f-hq8g2" Jul 06 21:09:12.645820 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:12.645802 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56589b7e-e251-4b7a-a8e7-48c90ab765ed-trusted-ca-bundle\") pod \"console-846c49bc6f-hq8g2\" (UID: \"56589b7e-e251-4b7a-a8e7-48c90ab765ed\") " pod="openshift-console/console-846c49bc6f-hq8g2" Jul 06 21:09:12.647289 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:12.647266 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/56589b7e-e251-4b7a-a8e7-48c90ab765ed-console-serving-cert\") pod \"console-846c49bc6f-hq8g2\" (UID: \"56589b7e-e251-4b7a-a8e7-48c90ab765ed\") " pod="openshift-console/console-846c49bc6f-hq8g2" Jul 06 21:09:12.647461 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:12.647443 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/56589b7e-e251-4b7a-a8e7-48c90ab765ed-console-oauth-config\") pod \"console-846c49bc6f-hq8g2\" (UID: \"56589b7e-e251-4b7a-a8e7-48c90ab765ed\") " pod="openshift-console/console-846c49bc6f-hq8g2" Jul 06 21:09:12.653355 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:12.653307 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fl7q\" (UniqueName: \"kubernetes.io/projected/56589b7e-e251-4b7a-a8e7-48c90ab765ed-kube-api-access-9fl7q\") pod \"console-846c49bc6f-hq8g2\" (UID: \"56589b7e-e251-4b7a-a8e7-48c90ab765ed\") " pod="openshift-console/console-846c49bc6f-hq8g2" Jul 06 21:09:12.753113 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:12.753030 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-846c49bc6f-hq8g2" Jul 06 21:09:12.879103 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:12.879076 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-846c49bc6f-hq8g2"] Jul 06 21:09:12.881882 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:09:12.881853 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56589b7e_e251_4b7a_a8e7_48c90ab765ed.slice/crio-2ae3afd3b94fbc9565f042a87ee4326f15d7083787e2a939e98a5dfcd182bcfd WatchSource:0}: Error finding container 2ae3afd3b94fbc9565f042a87ee4326f15d7083787e2a939e98a5dfcd182bcfd: Status 404 returned error can't find the container with id 2ae3afd3b94fbc9565f042a87ee4326f15d7083787e2a939e98a5dfcd182bcfd Jul 06 21:09:12.960703 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:12.960669 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-pftrl" Jul 06 21:09:12.990416 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:12.990381 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-846c49bc6f-hq8g2" event={"ID":"56589b7e-e251-4b7a-a8e7-48c90ab765ed","Type":"ContainerStarted","Data":"2ae3afd3b94fbc9565f042a87ee4326f15d7083787e2a939e98a5dfcd182bcfd"} Jul 06 21:09:13.921559 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:13.921532 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nsmng_67ff5eff-b2cf-45c9-ab38-9650657413b9/ovn-acl-logging/0.log" Jul 06 21:09:13.926100 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:13.926058 2563 kubelet.go:1648] "Image garbage collection succeeded" Jul 06 21:09:13.934141 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:13.934119 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nsmng_67ff5eff-b2cf-45c9-ab38-9650657413b9/ovn-acl-logging/0.log" Jul 06 21:09:17.005139 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:17.005102 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-846c49bc6f-hq8g2" event={"ID":"56589b7e-e251-4b7a-a8e7-48c90ab765ed","Type":"ContainerStarted","Data":"bf6bc20308bd9df2ef541a480a8398999ff3af48105aee2652f62c172a0606cc"} Jul 06 21:09:17.027120 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:17.027074 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-846c49bc6f-hq8g2" podStartSLOduration=1.8708178009999998 podStartE2EDuration="5.027060486s" totalImagesPullingTime="3.156242685s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:09:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:09:17.026688654 +0000 UTC m=+303.544926835" watchObservedRunningTime="2026-07-06 21:09:17.027060486 +0000 UTC m=+303.545298617" Jul 06 21:09:19.239927 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:19.239890 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-65d484654d-d45tf"] Jul 06 21:09:19.244101 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:19.244073 2563 patch_prober.go:28] interesting pod/image-registry-65d484654d-d45tf container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 06 21:09:19.244234 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:19.244116 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-65d484654d-d45tf" podUID="21e6ad8b-efe9-4faf-a400-e1014c3dfbb5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 21:09:22.077758 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:22.077717 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-252n9"] Jul 06 21:09:22.081572 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:22.081547 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-q8jq5"] Jul 06 21:09:22.081819 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:22.081680 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-252n9" Jul 06 21:09:22.084836 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:22.084817 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 21:09:22.085002 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:22.084982 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 21:09:22.085362 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:22.085343 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-q8jq5" Jul 06 21:09:22.085475 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:22.085461 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 21:09:22.085819 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:22.085804 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mt66v\"" Jul 06 21:09:22.086042 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:22.085876 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 21:09:22.088088 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:22.088071 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 06 21:09:22.088348 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:22.088131 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 06 21:09:22.088629 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:22.088176 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-w6gwm\"" Jul 06 21:09:22.094006 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:22.093988 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-q8jq5"] Jul 06 21:09:22.130258 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:22.130225 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2da12811-32ad-492c-b6d7-92217ca15164-metrics-client-ca\") pod \"node-exporter-252n9\" (UID: \"2da12811-32ad-492c-b6d7-92217ca15164\") " pod="openshift-monitoring/node-exporter-252n9" Jul 06 21:09:22.130444 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:22.130336 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f21b17dd-4a00-4514-8ef8-3cb6ee5c3cf0-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-q8jq5\" (UID: \"f21b17dd-4a00-4514-8ef8-3cb6ee5c3cf0\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-q8jq5" Jul 06 21:09:22.130444 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:22.130385 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsrxx\" (UniqueName: \"kubernetes.io/projected/f21b17dd-4a00-4514-8ef8-3cb6ee5c3cf0-kube-api-access-wsrxx\") pod \"openshift-state-metrics-54cf96dfcf-q8jq5\" (UID: \"f21b17dd-4a00-4514-8ef8-3cb6ee5c3cf0\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-q8jq5" Jul 06 21:09:22.130557 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:22.130444 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2da12811-32ad-492c-b6d7-92217ca15164-root\") pod \"node-exporter-252n9\" (UID: \"2da12811-32ad-492c-b6d7-92217ca15164\") " pod="openshift-monitoring/node-exporter-252n9" Jul 06 21:09:22.130557 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:22.130478 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2da12811-32ad-492c-b6d7-92217ca15164-node-exporter-textfile\") pod \"node-exporter-252n9\" (UID: \"2da12811-32ad-492c-b6d7-92217ca15164\") " pod="openshift-monitoring/node-exporter-252n9" Jul 06 21:09:22.130557 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:22.130515 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2da12811-32ad-492c-b6d7-92217ca15164-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-252n9\" (UID: \"2da12811-32ad-492c-b6d7-92217ca15164\") " pod="openshift-monitoring/node-exporter-252n9" Jul 06 21:09:22.130697 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:22.130582 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gttm\" (UniqueName: \"kubernetes.io/projected/2da12811-32ad-492c-b6d7-92217ca15164-kube-api-access-5gttm\") pod \"node-exporter-252n9\" (UID: \"2da12811-32ad-492c-b6d7-92217ca15164\") " pod="openshift-monitoring/node-exporter-252n9" Jul 06 21:09:22.130697 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:22.130615 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f21b17dd-4a00-4514-8ef8-3cb6ee5c3cf0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-q8jq5\" (UID: \"f21b17dd-4a00-4514-8ef8-3cb6ee5c3cf0\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-q8jq5" Jul 06 21:09:22.130697 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:22.130660 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2da12811-32ad-492c-b6d7-92217ca15164-node-exporter-tls\") pod \"node-exporter-252n9\" (UID: \"2da12811-32ad-492c-b6d7-92217ca15164\") " pod="openshift-monitoring/node-exporter-252n9" Jul 06 21:09:22.130866 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:22.130722 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2da12811-32ad-492c-b6d7-92217ca15164-sys\") pod \"node-exporter-252n9\" (UID: \"2da12811-32ad-492c-b6d7-92217ca15164\") " pod="openshift-monitoring/node-exporter-252n9" Jul 06 21:09:22.130866 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:22.130759 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2da12811-32ad-492c-b6d7-92217ca15164-node-exporter-accelerators-collector-config\") pod \"node-exporter-252n9\" (UID: \"2da12811-32ad-492c-b6d7-92217ca15164\") " pod="openshift-monitoring/node-exporter-252n9" Jul 06 21:09:22.130866 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:22.130827 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2da12811-32ad-492c-b6d7-92217ca15164-node-exporter-wtmp\") pod \"node-exporter-252n9\" (UID: \"2da12811-32ad-492c-b6d7-92217ca15164\") " pod="openshift-monitoring/node-exporter-252n9" Jul 06 21:09:22.131009 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:22.130902 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f21b17dd-4a00-4514-8ef8-3cb6ee5c3cf0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-q8jq5\" (UID: \"f21b17dd-4a00-4514-8ef8-3cb6ee5c3cf0\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-q8jq5" Jul 06 21:09:22.231494 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:22.231455 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2da12811-32ad-492c-b6d7-92217ca15164-node-exporter-wtmp\") pod \"node-exporter-252n9\" (UID: \"2da12811-32ad-492c-b6d7-92217ca15164\") " pod="openshift-monitoring/node-exporter-252n9" Jul 06 21:09:22.231696 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:22.231511 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f21b17dd-4a00-4514-8ef8-3cb6ee5c3cf0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-q8jq5\" (UID: \"f21b17dd-4a00-4514-8ef8-3cb6ee5c3cf0\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-q8jq5" Jul 06 21:09:22.231696 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:22.231551 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2da12811-32ad-492c-b6d7-92217ca15164-metrics-client-ca\") pod \"node-exporter-252n9\" (UID: \"2da12811-32ad-492c-b6d7-92217ca15164\") " pod="openshift-monitoring/node-exporter-252n9" Jul 06 21:09:22.231696 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:22.231596 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f21b17dd-4a00-4514-8ef8-3cb6ee5c3cf0-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-q8jq5\" (UID: \"f21b17dd-4a00-4514-8ef8-3cb6ee5c3cf0\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-q8jq5" Jul 06 21:09:22.231696 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:22.231626 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsrxx\" (UniqueName: \"kubernetes.io/projected/f21b17dd-4a00-4514-8ef8-3cb6ee5c3cf0-kube-api-access-wsrxx\") pod \"openshift-state-metrics-54cf96dfcf-q8jq5\" (UID: \"f21b17dd-4a00-4514-8ef8-3cb6ee5c3cf0\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-q8jq5" Jul 06 21:09:22.231696 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:22.231652 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2da12811-32ad-492c-b6d7-92217ca15164-root\") pod \"node-exporter-252n9\" (UID: \"2da12811-32ad-492c-b6d7-92217ca15164\") " pod="openshift-monitoring/node-exporter-252n9" Jul 06 21:09:22.231696 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:22.231677 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2da12811-32ad-492c-b6d7-92217ca15164-node-exporter-textfile\") pod \"node-exporter-252n9\" (UID: \"2da12811-32ad-492c-b6d7-92217ca15164\") " pod="openshift-monitoring/node-exporter-252n9" Jul 06 21:09:22.231997 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:22.231703 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2da12811-32ad-492c-b6d7-92217ca15164-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-252n9\" (UID: \"2da12811-32ad-492c-b6d7-92217ca15164\") " pod="openshift-monitoring/node-exporter-252n9" Jul 06 21:09:22.231997 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:22.231732 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gttm\" (UniqueName: \"kubernetes.io/projected/2da12811-32ad-492c-b6d7-92217ca15164-kube-api-access-5gttm\") pod \"node-exporter-252n9\" (UID: \"2da12811-32ad-492c-b6d7-92217ca15164\") " pod="openshift-monitoring/node-exporter-252n9" Jul 06 21:09:22.231997 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:22.231762 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f21b17dd-4a00-4514-8ef8-3cb6ee5c3cf0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-q8jq5\" (UID: \"f21b17dd-4a00-4514-8ef8-3cb6ee5c3cf0\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-q8jq5" Jul 06 21:09:22.231997 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:22.231792 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2da12811-32ad-492c-b6d7-92217ca15164-node-exporter-tls\") pod \"node-exporter-252n9\" (UID: \"2da12811-32ad-492c-b6d7-92217ca15164\") " pod="openshift-monitoring/node-exporter-252n9" Jul 06 21:09:22.231997 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:22.231821 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2da12811-32ad-492c-b6d7-92217ca15164-sys\") pod \"node-exporter-252n9\" (UID: \"2da12811-32ad-492c-b6d7-92217ca15164\") " pod="openshift-monitoring/node-exporter-252n9" Jul 06 21:09:22.231997 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:22.231858 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2da12811-32ad-492c-b6d7-92217ca15164-node-exporter-accelerators-collector-config\") pod \"node-exporter-252n9\" (UID: \"2da12811-32ad-492c-b6d7-92217ca15164\") " pod="openshift-monitoring/node-exporter-252n9" Jul 06 21:09:22.232496 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:22.232469 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2da12811-32ad-492c-b6d7-92217ca15164-node-exporter-wtmp\") pod \"node-exporter-252n9\" (UID: \"2da12811-32ad-492c-b6d7-92217ca15164\") " pod="openshift-monitoring/node-exporter-252n9" Jul 06 21:09:22.232626 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:22.232517 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2da12811-32ad-492c-b6d7-92217ca15164-node-exporter-accelerators-collector-config\") pod \"node-exporter-252n9\" (UID: \"2da12811-32ad-492c-b6d7-92217ca15164\") " pod="openshift-monitoring/node-exporter-252n9" Jul 06 21:09:22.232781 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:09:22.232768 2563 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 06 21:09:22.232899 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:09:22.232891 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f21b17dd-4a00-4514-8ef8-3cb6ee5c3cf0-openshift-state-metrics-tls podName:f21b17dd-4a00-4514-8ef8-3cb6ee5c3cf0 nodeName:}" failed. No retries permitted until 2026-07-06 21:09:22.732872099 +0000 UTC m=+309.251110226 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/f21b17dd-4a00-4514-8ef8-3cb6ee5c3cf0-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-q8jq5" (UID: "f21b17dd-4a00-4514-8ef8-3cb6ee5c3cf0") : secret "openshift-state-metrics-tls" not found Jul 06 21:09:22.233174 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:09:22.233152 2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 06 21:09:22.233250 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:09:22.233218 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2da12811-32ad-492c-b6d7-92217ca15164-node-exporter-tls podName:2da12811-32ad-492c-b6d7-92217ca15164 nodeName:}" failed. No retries permitted until 2026-07-06 21:09:22.73319964 +0000 UTC m=+309.251437764 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/2da12811-32ad-492c-b6d7-92217ca15164-node-exporter-tls") pod "node-exporter-252n9" (UID: "2da12811-32ad-492c-b6d7-92217ca15164") : secret "node-exporter-tls" not found Jul 06 21:09:22.233366 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:22.233344 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2da12811-32ad-492c-b6d7-92217ca15164-metrics-client-ca\") pod \"node-exporter-252n9\" (UID: \"2da12811-32ad-492c-b6d7-92217ca15164\") " pod="openshift-monitoring/node-exporter-252n9" Jul 06 21:09:22.233433 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:22.233353 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2da12811-32ad-492c-b6d7-92217ca15164-root\") pod \"node-exporter-252n9\" (UID: \"2da12811-32ad-492c-b6d7-92217ca15164\") " pod="openshift-monitoring/node-exporter-252n9" Jul 06 21:09:22.233487 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:22.233427 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f21b17dd-4a00-4514-8ef8-3cb6ee5c3cf0-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-q8jq5\" (UID: \"f21b17dd-4a00-4514-8ef8-3cb6ee5c3cf0\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-q8jq5" Jul 06 21:09:22.233581 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:22.233564 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2da12811-32ad-492c-b6d7-92217ca15164-sys\") pod \"node-exporter-252n9\" (UID: \"2da12811-32ad-492c-b6d7-92217ca15164\") " pod="openshift-monitoring/node-exporter-252n9" Jul 06 21:09:22.233671 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:22.233594 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2da12811-32ad-492c-b6d7-92217ca15164-node-exporter-textfile\") pod \"node-exporter-252n9\" (UID: \"2da12811-32ad-492c-b6d7-92217ca15164\") " pod="openshift-monitoring/node-exporter-252n9" Jul 06 21:09:22.235744 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:22.235275 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f21b17dd-4a00-4514-8ef8-3cb6ee5c3cf0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-q8jq5\" (UID: \"f21b17dd-4a00-4514-8ef8-3cb6ee5c3cf0\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-q8jq5" Jul 06 21:09:22.235744 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:22.235691 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2da12811-32ad-492c-b6d7-92217ca15164-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-252n9\" (UID: \"2da12811-32ad-492c-b6d7-92217ca15164\") " pod="openshift-monitoring/node-exporter-252n9" Jul 06 21:09:22.243324 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:22.242766 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsrxx\" (UniqueName: \"kubernetes.io/projected/f21b17dd-4a00-4514-8ef8-3cb6ee5c3cf0-kube-api-access-wsrxx\") pod \"openshift-state-metrics-54cf96dfcf-q8jq5\" (UID: \"f21b17dd-4a00-4514-8ef8-3cb6ee5c3cf0\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-q8jq5" Jul 06 21:09:22.243617 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:22.243562 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gttm\" (UniqueName: \"kubernetes.io/projected/2da12811-32ad-492c-b6d7-92217ca15164-kube-api-access-5gttm\") pod \"node-exporter-252n9\" (UID: \"2da12811-32ad-492c-b6d7-92217ca15164\") " pod="openshift-monitoring/node-exporter-252n9" Jul 06 21:09:22.736246 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:22.736198 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2da12811-32ad-492c-b6d7-92217ca15164-node-exporter-tls\") pod \"node-exporter-252n9\" (UID: \"2da12811-32ad-492c-b6d7-92217ca15164\") " pod="openshift-monitoring/node-exporter-252n9" Jul 06 21:09:22.736476 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:22.736288 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f21b17dd-4a00-4514-8ef8-3cb6ee5c3cf0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-q8jq5\" (UID: \"f21b17dd-4a00-4514-8ef8-3cb6ee5c3cf0\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-q8jq5" Jul 06 21:09:22.738621 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:22.738583 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2da12811-32ad-492c-b6d7-92217ca15164-node-exporter-tls\") pod \"node-exporter-252n9\" (UID: \"2da12811-32ad-492c-b6d7-92217ca15164\") " pod="openshift-monitoring/node-exporter-252n9" Jul 06 21:09:22.738753 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:22.738675 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f21b17dd-4a00-4514-8ef8-3cb6ee5c3cf0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-q8jq5\" (UID: \"f21b17dd-4a00-4514-8ef8-3cb6ee5c3cf0\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-q8jq5" Jul 06 21:09:22.753529 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:22.753508 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-846c49bc6f-hq8g2" Jul 06 21:09:22.753620 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:22.753561 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-846c49bc6f-hq8g2" Jul 06 21:09:22.758236 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:22.758218 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-846c49bc6f-hq8g2" Jul 06 21:09:22.997820 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:22.997737 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-252n9" Jul 06 21:09:23.006097 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.006077 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-q8jq5" Jul 06 21:09:23.010834 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:09:23.010812 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2da12811_32ad_492c_b6d7_92217ca15164.slice/crio-69ec988f8b3030af2714106d4c35c8871bdfa6642db9052e8af2fc1f496f9dca WatchSource:0}: Error finding container 69ec988f8b3030af2714106d4c35c8871bdfa6642db9052e8af2fc1f496f9dca: Status 404 returned error can't find the container with id 69ec988f8b3030af2714106d4c35c8871bdfa6642db9052e8af2fc1f496f9dca Jul 06 21:09:23.013982 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.013966 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 21:09:23.029121 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.029093 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c795j" Jul 06 21:09:23.030494 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.030427 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-252n9" event={"ID":"2da12811-32ad-492c-b6d7-92217ca15164","Type":"ContainerStarted","Data":"69ec988f8b3030af2714106d4c35c8871bdfa6642db9052e8af2fc1f496f9dca"} Jul 06 21:09:23.034704 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.034683 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-846c49bc6f-hq8g2" Jul 06 21:09:23.150623 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.150594 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-q8jq5"] Jul 06 21:09:23.152929 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:09:23.152890 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf21b17dd_4a00_4514_8ef8_3cb6ee5c3cf0.slice/crio-be148cb20750f3d0edd87ff7550f2888bf4a6fdd2ebf1511e4315d0be7cdc283 WatchSource:0}: Error finding container be148cb20750f3d0edd87ff7550f2888bf4a6fdd2ebf1511e4315d0be7cdc283: Status 404 returned error can't find the container with id be148cb20750f3d0edd87ff7550f2888bf4a6fdd2ebf1511e4315d0be7cdc283 Jul 06 21:09:23.232183 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.232150 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 21:09:23.237559 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.237535 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:09:23.240746 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.240724 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 06 21:09:23.240857 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.240837 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 06 21:09:23.240930 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.240837 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 06 21:09:23.240995 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.240978 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 06 21:09:23.241167 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.241151 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 06 21:09:23.241221 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.241162 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 06 21:09:23.241269 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.241151 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-x2cts\"" Jul 06 21:09:23.241393 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.241380 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 06 21:09:23.241529 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.241512 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 06 21:09:23.241682 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.241635 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 06 21:09:23.249480 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.249356 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 21:09:23.340759 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.340721 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bb827a5a-a187-4169-9b6c-3f8d7d6db6ce-config-out\") pod \"alertmanager-main-0\" (UID: \"bb827a5a-a187-4169-9b6c-3f8d7d6db6ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:09:23.340759 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.340764 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bb827a5a-a187-4169-9b6c-3f8d7d6db6ce-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bb827a5a-a187-4169-9b6c-3f8d7d6db6ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:09:23.340995 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.340786 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bb827a5a-a187-4169-9b6c-3f8d7d6db6ce-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bb827a5a-a187-4169-9b6c-3f8d7d6db6ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:09:23.340995 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.340808 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bb827a5a-a187-4169-9b6c-3f8d7d6db6ce-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bb827a5a-a187-4169-9b6c-3f8d7d6db6ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:09:23.340995 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.340862 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb827a5a-a187-4169-9b6c-3f8d7d6db6ce-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bb827a5a-a187-4169-9b6c-3f8d7d6db6ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:09:23.340995 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.340880 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bb827a5a-a187-4169-9b6c-3f8d7d6db6ce-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bb827a5a-a187-4169-9b6c-3f8d7d6db6ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:09:23.340995 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.340896 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bb827a5a-a187-4169-9b6c-3f8d7d6db6ce-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bb827a5a-a187-4169-9b6c-3f8d7d6db6ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:09:23.340995 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.340915 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bb827a5a-a187-4169-9b6c-3f8d7d6db6ce-config-volume\") pod \"alertmanager-main-0\" (UID: \"bb827a5a-a187-4169-9b6c-3f8d7d6db6ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:09:23.340995 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.340954 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bb827a5a-a187-4169-9b6c-3f8d7d6db6ce-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bb827a5a-a187-4169-9b6c-3f8d7d6db6ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:09:23.340995 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.340981 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bb827a5a-a187-4169-9b6c-3f8d7d6db6ce-web-config\") pod \"alertmanager-main-0\" (UID: \"bb827a5a-a187-4169-9b6c-3f8d7d6db6ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:09:23.341451 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.341004 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bb827a5a-a187-4169-9b6c-3f8d7d6db6ce-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bb827a5a-a187-4169-9b6c-3f8d7d6db6ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:09:23.341451 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.341066 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bb827a5a-a187-4169-9b6c-3f8d7d6db6ce-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bb827a5a-a187-4169-9b6c-3f8d7d6db6ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:09:23.341451 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.341126 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8vlj\" (UniqueName: \"kubernetes.io/projected/bb827a5a-a187-4169-9b6c-3f8d7d6db6ce-kube-api-access-w8vlj\") pod \"alertmanager-main-0\" (UID: \"bb827a5a-a187-4169-9b6c-3f8d7d6db6ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:09:23.441564 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.441534 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bb827a5a-a187-4169-9b6c-3f8d7d6db6ce-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bb827a5a-a187-4169-9b6c-3f8d7d6db6ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:09:23.441755 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.441591 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bb827a5a-a187-4169-9b6c-3f8d7d6db6ce-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bb827a5a-a187-4169-9b6c-3f8d7d6db6ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:09:23.441755 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.441634 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8vlj\" (UniqueName: \"kubernetes.io/projected/bb827a5a-a187-4169-9b6c-3f8d7d6db6ce-kube-api-access-w8vlj\") pod \"alertmanager-main-0\" (UID: \"bb827a5a-a187-4169-9b6c-3f8d7d6db6ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:09:23.441755 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.441668 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bb827a5a-a187-4169-9b6c-3f8d7d6db6ce-config-out\") pod \"alertmanager-main-0\" (UID: \"bb827a5a-a187-4169-9b6c-3f8d7d6db6ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:09:23.441755 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.441689 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bb827a5a-a187-4169-9b6c-3f8d7d6db6ce-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bb827a5a-a187-4169-9b6c-3f8d7d6db6ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:09:23.442673 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.441992 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bb827a5a-a187-4169-9b6c-3f8d7d6db6ce-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bb827a5a-a187-4169-9b6c-3f8d7d6db6ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:09:23.442673 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.442039 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bb827a5a-a187-4169-9b6c-3f8d7d6db6ce-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bb827a5a-a187-4169-9b6c-3f8d7d6db6ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:09:23.442673 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.442084 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb827a5a-a187-4169-9b6c-3f8d7d6db6ce-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bb827a5a-a187-4169-9b6c-3f8d7d6db6ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:09:23.442673 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.442112 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bb827a5a-a187-4169-9b6c-3f8d7d6db6ce-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bb827a5a-a187-4169-9b6c-3f8d7d6db6ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:09:23.442673 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.442142 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bb827a5a-a187-4169-9b6c-3f8d7d6db6ce-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bb827a5a-a187-4169-9b6c-3f8d7d6db6ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:09:23.442673 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.442196 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bb827a5a-a187-4169-9b6c-3f8d7d6db6ce-config-volume\") pod \"alertmanager-main-0\" (UID: \"bb827a5a-a187-4169-9b6c-3f8d7d6db6ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:09:23.442673 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.442275 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bb827a5a-a187-4169-9b6c-3f8d7d6db6ce-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bb827a5a-a187-4169-9b6c-3f8d7d6db6ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:09:23.442673 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.442307 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bb827a5a-a187-4169-9b6c-3f8d7d6db6ce-web-config\") pod \"alertmanager-main-0\" (UID: \"bb827a5a-a187-4169-9b6c-3f8d7d6db6ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:09:23.442673 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.442655 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bb827a5a-a187-4169-9b6c-3f8d7d6db6ce-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bb827a5a-a187-4169-9b6c-3f8d7d6db6ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:09:23.443211 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.442884 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bb827a5a-a187-4169-9b6c-3f8d7d6db6ce-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bb827a5a-a187-4169-9b6c-3f8d7d6db6ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:09:23.444022 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:09:23.443397 2563 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 06 21:09:23.444022 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:09:23.443465 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb827a5a-a187-4169-9b6c-3f8d7d6db6ce-secret-alertmanager-main-tls podName:bb827a5a-a187-4169-9b6c-3f8d7d6db6ce nodeName:}" failed. No retries permitted until 2026-07-06 21:09:23.94344721 +0000 UTC m=+310.461685345 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/bb827a5a-a187-4169-9b6c-3f8d7d6db6ce-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "bb827a5a-a187-4169-9b6c-3f8d7d6db6ce") : secret "alertmanager-main-tls" not found Jul 06 21:09:23.444022 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.443970 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb827a5a-a187-4169-9b6c-3f8d7d6db6ce-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bb827a5a-a187-4169-9b6c-3f8d7d6db6ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:09:23.445798 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.445502 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bb827a5a-a187-4169-9b6c-3f8d7d6db6ce-config-out\") pod \"alertmanager-main-0\" (UID: \"bb827a5a-a187-4169-9b6c-3f8d7d6db6ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:09:23.445798 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.445749 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bb827a5a-a187-4169-9b6c-3f8d7d6db6ce-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bb827a5a-a187-4169-9b6c-3f8d7d6db6ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:09:23.446405 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.446360 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bb827a5a-a187-4169-9b6c-3f8d7d6db6ce-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bb827a5a-a187-4169-9b6c-3f8d7d6db6ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:09:23.446512 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.446431 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bb827a5a-a187-4169-9b6c-3f8d7d6db6ce-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bb827a5a-a187-4169-9b6c-3f8d7d6db6ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:09:23.447234 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.446872 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bb827a5a-a187-4169-9b6c-3f8d7d6db6ce-web-config\") pod \"alertmanager-main-0\" (UID: \"bb827a5a-a187-4169-9b6c-3f8d7d6db6ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:09:23.447234 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.446920 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bb827a5a-a187-4169-9b6c-3f8d7d6db6ce-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bb827a5a-a187-4169-9b6c-3f8d7d6db6ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:09:23.447234 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.447189 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bb827a5a-a187-4169-9b6c-3f8d7d6db6ce-config-volume\") pod \"alertmanager-main-0\" (UID: \"bb827a5a-a187-4169-9b6c-3f8d7d6db6ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:09:23.447592 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.447571 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bb827a5a-a187-4169-9b6c-3f8d7d6db6ce-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bb827a5a-a187-4169-9b6c-3f8d7d6db6ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:09:23.450158 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.450137 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8vlj\" (UniqueName: \"kubernetes.io/projected/bb827a5a-a187-4169-9b6c-3f8d7d6db6ce-kube-api-access-w8vlj\") pod \"alertmanager-main-0\" (UID: \"bb827a5a-a187-4169-9b6c-3f8d7d6db6ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:09:23.946849 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.946815 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bb827a5a-a187-4169-9b6c-3f8d7d6db6ce-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bb827a5a-a187-4169-9b6c-3f8d7d6db6ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:09:23.949672 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:23.949635 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bb827a5a-a187-4169-9b6c-3f8d7d6db6ce-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bb827a5a-a187-4169-9b6c-3f8d7d6db6ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:09:24.044826 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:24.044793 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-q8jq5" event={"ID":"f21b17dd-4a00-4514-8ef8-3cb6ee5c3cf0","Type":"ContainerStarted","Data":"47e455c592e39d108fedd699adf9d679142873727ebfd17224cc2233f4b89f09"} Jul 06 21:09:24.044967 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:24.044854 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-q8jq5" event={"ID":"f21b17dd-4a00-4514-8ef8-3cb6ee5c3cf0","Type":"ContainerStarted","Data":"1d29011dcb3ec31027b2e7d1a22d221eb14e9d21a1dc32f4afeddd7444076896"} Jul 06 21:09:24.044967 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:24.044883 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-q8jq5" event={"ID":"f21b17dd-4a00-4514-8ef8-3cb6ee5c3cf0","Type":"ContainerStarted","Data":"be148cb20750f3d0edd87ff7550f2888bf4a6fdd2ebf1511e4315d0be7cdc283"} Jul 06 21:09:24.115726 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:24.115688 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-566b589849-2pnvd"] Jul 06 21:09:24.119967 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:24.119945 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-566b589849-2pnvd" Jul 06 21:09:24.123064 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:24.123041 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 06 21:09:24.123522 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:24.123263 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 06 21:09:24.123522 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:24.123305 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 06 21:09:24.123522 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:24.123475 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 06 21:09:24.123742 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:24.123606 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-8rn4k\"" Jul 06 21:09:24.123742 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:24.123709 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-8ulp0pd2ehl93\"" Jul 06 21:09:24.123828 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:24.123768 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 06 21:09:24.133118 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:24.133093 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-566b589849-2pnvd"] Jul 06 21:09:24.175324 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:24.175288 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 21:09:24.248883 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:24.248775 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5ef5f50a-f6ea-4456-8f52-e88a513d37ef-secret-thanos-querier-tls\") pod \"thanos-querier-566b589849-2pnvd\" (UID: \"5ef5f50a-f6ea-4456-8f52-e88a513d37ef\") " pod="openshift-monitoring/thanos-querier-566b589849-2pnvd" Jul 06 21:09:24.248883 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:24.248820 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r58zr\" (UniqueName: \"kubernetes.io/projected/5ef5f50a-f6ea-4456-8f52-e88a513d37ef-kube-api-access-r58zr\") pod \"thanos-querier-566b589849-2pnvd\" (UID: \"5ef5f50a-f6ea-4456-8f52-e88a513d37ef\") " pod="openshift-monitoring/thanos-querier-566b589849-2pnvd" Jul 06 21:09:24.249075 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:24.248905 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5ef5f50a-f6ea-4456-8f52-e88a513d37ef-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-566b589849-2pnvd\" (UID: \"5ef5f50a-f6ea-4456-8f52-e88a513d37ef\") " pod="openshift-monitoring/thanos-querier-566b589849-2pnvd" Jul 06 21:09:24.249075 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:24.248931 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5ef5f50a-f6ea-4456-8f52-e88a513d37ef-secret-grpc-tls\") pod \"thanos-querier-566b589849-2pnvd\" (UID: \"5ef5f50a-f6ea-4456-8f52-e88a513d37ef\") " pod="openshift-monitoring/thanos-querier-566b589849-2pnvd" Jul 06 21:09:24.249075 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:24.248966 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5ef5f50a-f6ea-4456-8f52-e88a513d37ef-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-566b589849-2pnvd\" (UID: \"5ef5f50a-f6ea-4456-8f52-e88a513d37ef\") " pod="openshift-monitoring/thanos-querier-566b589849-2pnvd" Jul 06 21:09:24.249075 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:24.248999 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5ef5f50a-f6ea-4456-8f52-e88a513d37ef-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-566b589849-2pnvd\" (UID: \"5ef5f50a-f6ea-4456-8f52-e88a513d37ef\") " pod="openshift-monitoring/thanos-querier-566b589849-2pnvd" Jul 06 21:09:24.249075 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:24.249028 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5ef5f50a-f6ea-4456-8f52-e88a513d37ef-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-566b589849-2pnvd\" (UID: \"5ef5f50a-f6ea-4456-8f52-e88a513d37ef\") " pod="openshift-monitoring/thanos-querier-566b589849-2pnvd" Jul 06 21:09:24.249332 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:24.249124 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ef5f50a-f6ea-4456-8f52-e88a513d37ef-metrics-client-ca\") pod \"thanos-querier-566b589849-2pnvd\" (UID: \"5ef5f50a-f6ea-4456-8f52-e88a513d37ef\") " pod="openshift-monitoring/thanos-querier-566b589849-2pnvd" Jul 06 21:09:24.318427 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:24.318394 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 21:09:24.350057 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:24.350018 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5ef5f50a-f6ea-4456-8f52-e88a513d37ef-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-566b589849-2pnvd\" (UID: \"5ef5f50a-f6ea-4456-8f52-e88a513d37ef\") " pod="openshift-monitoring/thanos-querier-566b589849-2pnvd" Jul 06 21:09:24.350227 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:24.350069 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5ef5f50a-f6ea-4456-8f52-e88a513d37ef-secret-grpc-tls\") pod \"thanos-querier-566b589849-2pnvd\" (UID: \"5ef5f50a-f6ea-4456-8f52-e88a513d37ef\") " pod="openshift-monitoring/thanos-querier-566b589849-2pnvd" Jul 06 21:09:24.350227 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:24.350097 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5ef5f50a-f6ea-4456-8f52-e88a513d37ef-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-566b589849-2pnvd\" (UID: \"5ef5f50a-f6ea-4456-8f52-e88a513d37ef\") " pod="openshift-monitoring/thanos-querier-566b589849-2pnvd" Jul 06 21:09:24.350227 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:24.350131 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5ef5f50a-f6ea-4456-8f52-e88a513d37ef-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-566b589849-2pnvd\" (UID: \"5ef5f50a-f6ea-4456-8f52-e88a513d37ef\") " pod="openshift-monitoring/thanos-querier-566b589849-2pnvd" Jul 06 21:09:24.350227 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:24.350163 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5ef5f50a-f6ea-4456-8f52-e88a513d37ef-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-566b589849-2pnvd\" (UID: \"5ef5f50a-f6ea-4456-8f52-e88a513d37ef\") " pod="openshift-monitoring/thanos-querier-566b589849-2pnvd" Jul 06 21:09:24.350482 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:24.350236 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ef5f50a-f6ea-4456-8f52-e88a513d37ef-metrics-client-ca\") pod \"thanos-querier-566b589849-2pnvd\" (UID: \"5ef5f50a-f6ea-4456-8f52-e88a513d37ef\") " pod="openshift-monitoring/thanos-querier-566b589849-2pnvd" Jul 06 21:09:24.350482 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:24.350384 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5ef5f50a-f6ea-4456-8f52-e88a513d37ef-secret-thanos-querier-tls\") pod \"thanos-querier-566b589849-2pnvd\" (UID: \"5ef5f50a-f6ea-4456-8f52-e88a513d37ef\") " pod="openshift-monitoring/thanos-querier-566b589849-2pnvd" Jul 06 21:09:24.350482 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:24.350420 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r58zr\" (UniqueName: \"kubernetes.io/projected/5ef5f50a-f6ea-4456-8f52-e88a513d37ef-kube-api-access-r58zr\") pod \"thanos-querier-566b589849-2pnvd\" (UID: \"5ef5f50a-f6ea-4456-8f52-e88a513d37ef\") " pod="openshift-monitoring/thanos-querier-566b589849-2pnvd" Jul 06 21:09:24.351039 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:24.350984 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ef5f50a-f6ea-4456-8f52-e88a513d37ef-metrics-client-ca\") pod \"thanos-querier-566b589849-2pnvd\" (UID: \"5ef5f50a-f6ea-4456-8f52-e88a513d37ef\") " pod="openshift-monitoring/thanos-querier-566b589849-2pnvd" Jul 06 21:09:24.353230 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:24.353197 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5ef5f50a-f6ea-4456-8f52-e88a513d37ef-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-566b589849-2pnvd\" (UID: \"5ef5f50a-f6ea-4456-8f52-e88a513d37ef\") " pod="openshift-monitoring/thanos-querier-566b589849-2pnvd" Jul 06 21:09:24.353230 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:24.353208 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5ef5f50a-f6ea-4456-8f52-e88a513d37ef-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-566b589849-2pnvd\" (UID: \"5ef5f50a-f6ea-4456-8f52-e88a513d37ef\") " pod="openshift-monitoring/thanos-querier-566b589849-2pnvd" Jul 06 21:09:24.353718 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:24.353673 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5ef5f50a-f6ea-4456-8f52-e88a513d37ef-secret-thanos-querier-tls\") pod \"thanos-querier-566b589849-2pnvd\" (UID: \"5ef5f50a-f6ea-4456-8f52-e88a513d37ef\") " pod="openshift-monitoring/thanos-querier-566b589849-2pnvd" Jul 06 21:09:24.353970 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:24.353919 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5ef5f50a-f6ea-4456-8f52-e88a513d37ef-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-566b589849-2pnvd\" (UID: \"5ef5f50a-f6ea-4456-8f52-e88a513d37ef\") " pod="openshift-monitoring/thanos-querier-566b589849-2pnvd" Jul 06 21:09:24.353970 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:24.353951 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5ef5f50a-f6ea-4456-8f52-e88a513d37ef-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-566b589849-2pnvd\" (UID: \"5ef5f50a-f6ea-4456-8f52-e88a513d37ef\") " pod="openshift-monitoring/thanos-querier-566b589849-2pnvd" Jul 06 21:09:24.354292 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:24.354265 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5ef5f50a-f6ea-4456-8f52-e88a513d37ef-secret-grpc-tls\") pod \"thanos-querier-566b589849-2pnvd\" (UID: \"5ef5f50a-f6ea-4456-8f52-e88a513d37ef\") " pod="openshift-monitoring/thanos-querier-566b589849-2pnvd" Jul 06 21:09:24.358493 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:24.358471 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r58zr\" (UniqueName: \"kubernetes.io/projected/5ef5f50a-f6ea-4456-8f52-e88a513d37ef-kube-api-access-r58zr\") pod \"thanos-querier-566b589849-2pnvd\" (UID: \"5ef5f50a-f6ea-4456-8f52-e88a513d37ef\") " pod="openshift-monitoring/thanos-querier-566b589849-2pnvd" Jul 06 21:09:24.432624 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:24.432578 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-566b589849-2pnvd" Jul 06 21:09:24.474164 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:09:24.474125 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb827a5a_a187_4169_9b6c_3f8d7d6db6ce.slice/crio-aeb1cef488ee476f6cf01bea1062643049aa7dde2ef7b735fbaddf464b340a74 WatchSource:0}: Error finding container aeb1cef488ee476f6cf01bea1062643049aa7dde2ef7b735fbaddf464b340a74: Status 404 returned error can't find the container with id aeb1cef488ee476f6cf01bea1062643049aa7dde2ef7b735fbaddf464b340a74 Jul 06 21:09:24.603884 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:24.603790 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-566b589849-2pnvd"] Jul 06 21:09:24.606666 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:09:24.606640 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ef5f50a_f6ea_4456_8f52_e88a513d37ef.slice/crio-ae6b44a9f835edd491980e28539f6e5d7d3cf68cc01f321542c59b06f0f6957c WatchSource:0}: Error finding container ae6b44a9f835edd491980e28539f6e5d7d3cf68cc01f321542c59b06f0f6957c: Status 404 returned error can't find the container with id ae6b44a9f835edd491980e28539f6e5d7d3cf68cc01f321542c59b06f0f6957c Jul 06 21:09:25.052789 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:25.052750 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-q8jq5" event={"ID":"f21b17dd-4a00-4514-8ef8-3cb6ee5c3cf0","Type":"ContainerStarted","Data":"ad2753d7f940f1b7600fb2c8eb1c9d3354573e9422052b8f30d9b4d7d009284d"} Jul 06 21:09:25.055177 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:25.055074 2563 generic.go:356] "Generic (PLEG): container finished" podID="2da12811-32ad-492c-b6d7-92217ca15164" containerID="60916a4ea6e6e9f50d7aa879f31a4c742aebe55d28f6357927804aabc69563ef" exitCode=0 Jul 06 21:09:25.055375 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:25.055173 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-252n9" event={"ID":"2da12811-32ad-492c-b6d7-92217ca15164","Type":"ContainerDied","Data":"60916a4ea6e6e9f50d7aa879f31a4c742aebe55d28f6357927804aabc69563ef"} Jul 06 21:09:25.056684 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:25.056609 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-566b589849-2pnvd" event={"ID":"5ef5f50a-f6ea-4456-8f52-e88a513d37ef","Type":"ContainerStarted","Data":"ae6b44a9f835edd491980e28539f6e5d7d3cf68cc01f321542c59b06f0f6957c"} Jul 06 21:09:25.058713 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:25.058644 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bb827a5a-a187-4169-9b6c-3f8d7d6db6ce","Type":"ContainerStarted","Data":"aeb1cef488ee476f6cf01bea1062643049aa7dde2ef7b735fbaddf464b340a74"} Jul 06 21:09:25.072751 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:25.072707 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-q8jq5" podStartSLOduration=1.835976337 podStartE2EDuration="3.072688447s" totalImagesPullingTime="1.23671211s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:09:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:09:25.072259214 +0000 UTC m=+311.590497349" watchObservedRunningTime="2026-07-06 21:09:25.072688447 +0000 UTC m=+311.590926582" Jul 06 21:09:26.064444 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:26.064331 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-252n9" event={"ID":"2da12811-32ad-492c-b6d7-92217ca15164","Type":"ContainerStarted","Data":"c1feeb35a051d1dd300ae1960fdfc20078ab909c9f39112275aba23846aa4580"} Jul 06 21:09:26.064444 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:26.064399 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-252n9" event={"ID":"2da12811-32ad-492c-b6d7-92217ca15164","Type":"ContainerStarted","Data":"ced2747591fdd943b9efc11350a25eecc722b565efe5cfb6dac23efd4ced5b00"} Jul 06 21:09:26.065985 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:26.065956 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bb827a5a-a187-4169-9b6c-3f8d7d6db6ce","Type":"ContainerDied","Data":"e4daffbfc5991b99187ca540041734f3aecf9c8f37e1aed255be53886db0ae52"} Jul 06 21:09:26.066124 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:26.065877 2563 generic.go:356] "Generic (PLEG): container finished" podID="bb827a5a-a187-4169-9b6c-3f8d7d6db6ce" containerID="e4daffbfc5991b99187ca540041734f3aecf9c8f37e1aed255be53886db0ae52" exitCode=0 Jul 06 21:09:26.084879 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:26.084835 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-252n9" podStartSLOduration=3.014082683 podStartE2EDuration="4.08482115s" totalImagesPullingTime="996.05008ms" totalInitContainerRuntime="74.688387ms" isStatefulPod=true podCreationTimestamp="2026-07-06 21:09:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:09:26.083482212 +0000 UTC m=+312.601720346" watchObservedRunningTime="2026-07-06 21:09:26.08482115 +0000 UTC m=+312.603059282" Jul 06 21:09:26.343752 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:26.343672 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-69bc7f949b-gksxt"] Jul 06 21:09:26.363206 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:26.363166 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-69bc7f949b-gksxt"] Jul 06 21:09:26.363395 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:26.363303 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-69bc7f949b-gksxt" Jul 06 21:09:26.366504 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:26.366166 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 06 21:09:26.366504 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:26.366195 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-6b31taoh6fr9a\"" Jul 06 21:09:26.366504 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:26.366200 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 06 21:09:26.366504 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:26.366170 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 06 21:09:26.367390 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:26.367344 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 06 21:09:26.367502 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:26.367396 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-ptrdn\"" Jul 06 21:09:26.467784 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:26.467750 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xblvr\" (UniqueName: \"kubernetes.io/projected/2dbbcfaa-9d5d-4185-b92c-b56ad201875c-kube-api-access-xblvr\") pod \"metrics-server-69bc7f949b-gksxt\" (UID: \"2dbbcfaa-9d5d-4185-b92c-b56ad201875c\") " pod="openshift-monitoring/metrics-server-69bc7f949b-gksxt" Jul 06 21:09:26.467964 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:26.467793 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2dbbcfaa-9d5d-4185-b92c-b56ad201875c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-69bc7f949b-gksxt\" (UID: \"2dbbcfaa-9d5d-4185-b92c-b56ad201875c\") " pod="openshift-monitoring/metrics-server-69bc7f949b-gksxt" Jul 06 21:09:26.467964 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:26.467829 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2dbbcfaa-9d5d-4185-b92c-b56ad201875c-metrics-server-audit-profiles\") pod \"metrics-server-69bc7f949b-gksxt\" (UID: \"2dbbcfaa-9d5d-4185-b92c-b56ad201875c\") " pod="openshift-monitoring/metrics-server-69bc7f949b-gksxt" Jul 06 21:09:26.467964 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:26.467883 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2dbbcfaa-9d5d-4185-b92c-b56ad201875c-client-ca-bundle\") pod \"metrics-server-69bc7f949b-gksxt\" (UID: \"2dbbcfaa-9d5d-4185-b92c-b56ad201875c\") " pod="openshift-monitoring/metrics-server-69bc7f949b-gksxt" Jul 06 21:09:26.467964 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:26.467911 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2dbbcfaa-9d5d-4185-b92c-b56ad201875c-secret-metrics-server-tls\") pod \"metrics-server-69bc7f949b-gksxt\" (UID: \"2dbbcfaa-9d5d-4185-b92c-b56ad201875c\") " pod="openshift-monitoring/metrics-server-69bc7f949b-gksxt" Jul 06 21:09:26.467964 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:26.467936 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2dbbcfaa-9d5d-4185-b92c-b56ad201875c-secret-metrics-server-client-certs\") pod \"metrics-server-69bc7f949b-gksxt\" (UID: \"2dbbcfaa-9d5d-4185-b92c-b56ad201875c\") " pod="openshift-monitoring/metrics-server-69bc7f949b-gksxt" Jul 06 21:09:26.468166 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:26.468012 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2dbbcfaa-9d5d-4185-b92c-b56ad201875c-audit-log\") pod \"metrics-server-69bc7f949b-gksxt\" (UID: \"2dbbcfaa-9d5d-4185-b92c-b56ad201875c\") " pod="openshift-monitoring/metrics-server-69bc7f949b-gksxt" Jul 06 21:09:26.568677 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:26.568634 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2dbbcfaa-9d5d-4185-b92c-b56ad201875c-audit-log\") pod \"metrics-server-69bc7f949b-gksxt\" (UID: \"2dbbcfaa-9d5d-4185-b92c-b56ad201875c\") " pod="openshift-monitoring/metrics-server-69bc7f949b-gksxt" Jul 06 21:09:26.568855 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:26.568713 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xblvr\" (UniqueName: \"kubernetes.io/projected/2dbbcfaa-9d5d-4185-b92c-b56ad201875c-kube-api-access-xblvr\") pod \"metrics-server-69bc7f949b-gksxt\" (UID: \"2dbbcfaa-9d5d-4185-b92c-b56ad201875c\") " pod="openshift-monitoring/metrics-server-69bc7f949b-gksxt" Jul 06 21:09:26.568855 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:26.568754 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2dbbcfaa-9d5d-4185-b92c-b56ad201875c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-69bc7f949b-gksxt\" (UID: \"2dbbcfaa-9d5d-4185-b92c-b56ad201875c\") " pod="openshift-monitoring/metrics-server-69bc7f949b-gksxt" Jul 06 21:09:26.568855 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:26.568781 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2dbbcfaa-9d5d-4185-b92c-b56ad201875c-metrics-server-audit-profiles\") pod \"metrics-server-69bc7f949b-gksxt\" (UID: \"2dbbcfaa-9d5d-4185-b92c-b56ad201875c\") " pod="openshift-monitoring/metrics-server-69bc7f949b-gksxt" Jul 06 21:09:26.569025 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:26.568856 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2dbbcfaa-9d5d-4185-b92c-b56ad201875c-client-ca-bundle\") pod \"metrics-server-69bc7f949b-gksxt\" (UID: \"2dbbcfaa-9d5d-4185-b92c-b56ad201875c\") " pod="openshift-monitoring/metrics-server-69bc7f949b-gksxt" Jul 06 21:09:26.569025 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:26.568884 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2dbbcfaa-9d5d-4185-b92c-b56ad201875c-secret-metrics-server-tls\") pod \"metrics-server-69bc7f949b-gksxt\" (UID: \"2dbbcfaa-9d5d-4185-b92c-b56ad201875c\") " pod="openshift-monitoring/metrics-server-69bc7f949b-gksxt" Jul 06 21:09:26.569025 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:26.568915 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2dbbcfaa-9d5d-4185-b92c-b56ad201875c-secret-metrics-server-client-certs\") pod \"metrics-server-69bc7f949b-gksxt\" (UID: \"2dbbcfaa-9d5d-4185-b92c-b56ad201875c\") " pod="openshift-monitoring/metrics-server-69bc7f949b-gksxt" Jul 06 21:09:26.569025 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:26.569008 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2dbbcfaa-9d5d-4185-b92c-b56ad201875c-audit-log\") pod \"metrics-server-69bc7f949b-gksxt\" (UID: \"2dbbcfaa-9d5d-4185-b92c-b56ad201875c\") " pod="openshift-monitoring/metrics-server-69bc7f949b-gksxt" Jul 06 21:09:26.569719 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:26.569685 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2dbbcfaa-9d5d-4185-b92c-b56ad201875c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-69bc7f949b-gksxt\" (UID: \"2dbbcfaa-9d5d-4185-b92c-b56ad201875c\") " pod="openshift-monitoring/metrics-server-69bc7f949b-gksxt" Jul 06 21:09:26.569957 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:26.569923 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2dbbcfaa-9d5d-4185-b92c-b56ad201875c-metrics-server-audit-profiles\") pod \"metrics-server-69bc7f949b-gksxt\" (UID: \"2dbbcfaa-9d5d-4185-b92c-b56ad201875c\") " pod="openshift-monitoring/metrics-server-69bc7f949b-gksxt" Jul 06 21:09:26.571979 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:26.571950 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2dbbcfaa-9d5d-4185-b92c-b56ad201875c-secret-metrics-server-tls\") pod \"metrics-server-69bc7f949b-gksxt\" (UID: \"2dbbcfaa-9d5d-4185-b92c-b56ad201875c\") " pod="openshift-monitoring/metrics-server-69bc7f949b-gksxt" Jul 06 21:09:26.572106 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:26.572015 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2dbbcfaa-9d5d-4185-b92c-b56ad201875c-secret-metrics-server-client-certs\") pod \"metrics-server-69bc7f949b-gksxt\" (UID: \"2dbbcfaa-9d5d-4185-b92c-b56ad201875c\") " pod="openshift-monitoring/metrics-server-69bc7f949b-gksxt" Jul 06 21:09:26.572225 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:26.572204 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2dbbcfaa-9d5d-4185-b92c-b56ad201875c-client-ca-bundle\") pod \"metrics-server-69bc7f949b-gksxt\" (UID: \"2dbbcfaa-9d5d-4185-b92c-b56ad201875c\") " pod="openshift-monitoring/metrics-server-69bc7f949b-gksxt" Jul 06 21:09:26.577881 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:26.577846 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xblvr\" (UniqueName: \"kubernetes.io/projected/2dbbcfaa-9d5d-4185-b92c-b56ad201875c-kube-api-access-xblvr\") pod \"metrics-server-69bc7f949b-gksxt\" (UID: \"2dbbcfaa-9d5d-4185-b92c-b56ad201875c\") " pod="openshift-monitoring/metrics-server-69bc7f949b-gksxt" Jul 06 21:09:26.675050 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:26.675010 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-69bc7f949b-gksxt" Jul 06 21:09:26.891017 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:26.890982 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-gldhc"] Jul 06 21:09:26.906243 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:26.905913 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-gldhc"] Jul 06 21:09:26.906243 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:26.906047 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-gldhc" Jul 06 21:09:26.908934 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:26.908909 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-4lv8n\"" Jul 06 21:09:26.909624 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:26.909184 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 06 21:09:26.973149 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:26.973114 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e991381e-f373-488a-94a5-0ab6c4426990-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-gldhc\" (UID: \"e991381e-f373-488a-94a5-0ab6c4426990\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-gldhc" Jul 06 21:09:26.973289 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:26.973183 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58j9v\" (UniqueName: \"kubernetes.io/projected/e991381e-f373-488a-94a5-0ab6c4426990-kube-api-access-58j9v\") pod \"monitoring-plugin-d5dcff7cf-gldhc\" (UID: \"e991381e-f373-488a-94a5-0ab6c4426990\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-gldhc" Jul 06 21:09:26.978918 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:26.978744 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-69bc7f949b-gksxt"] Jul 06 21:09:26.981602 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:09:26.981572 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dbbcfaa_9d5d_4185_b92c_b56ad201875c.slice/crio-d494ae410437aac9c8dd5684a88f8c7c19872167ab233a87031e084426e4d48c WatchSource:0}: Error finding container d494ae410437aac9c8dd5684a88f8c7c19872167ab233a87031e084426e4d48c: Status 404 returned error can't find the container with id d494ae410437aac9c8dd5684a88f8c7c19872167ab233a87031e084426e4d48c Jul 06 21:09:27.071578 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:27.071545 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-69bc7f949b-gksxt" event={"ID":"2dbbcfaa-9d5d-4185-b92c-b56ad201875c","Type":"ContainerStarted","Data":"d494ae410437aac9c8dd5684a88f8c7c19872167ab233a87031e084426e4d48c"} Jul 06 21:09:27.074246 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:27.074226 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e991381e-f373-488a-94a5-0ab6c4426990-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-gldhc\" (UID: \"e991381e-f373-488a-94a5-0ab6c4426990\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-gldhc" Jul 06 21:09:27.074358 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:27.074275 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58j9v\" (UniqueName: \"kubernetes.io/projected/e991381e-f373-488a-94a5-0ab6c4426990-kube-api-access-58j9v\") pod \"monitoring-plugin-d5dcff7cf-gldhc\" (UID: \"e991381e-f373-488a-94a5-0ab6c4426990\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-gldhc" Jul 06 21:09:27.074430 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:09:27.074413 2563 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 06 21:09:27.074491 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:09:27.074483 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e991381e-f373-488a-94a5-0ab6c4426990-monitoring-plugin-cert podName:e991381e-f373-488a-94a5-0ab6c4426990 nodeName:}" failed. No retries permitted until 2026-07-06 21:09:27.574460861 +0000 UTC m=+314.092698987 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/e991381e-f373-488a-94a5-0ab6c4426990-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-gldhc" (UID: "e991381e-f373-488a-94a5-0ab6c4426990") : secret "monitoring-plugin-cert" not found Jul 06 21:09:27.084596 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:27.084559 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58j9v\" (UniqueName: \"kubernetes.io/projected/e991381e-f373-488a-94a5-0ab6c4426990-kube-api-access-58j9v\") pod \"monitoring-plugin-d5dcff7cf-gldhc\" (UID: \"e991381e-f373-488a-94a5-0ab6c4426990\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-gldhc" Jul 06 21:09:27.578113 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:27.578063 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e991381e-f373-488a-94a5-0ab6c4426990-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-gldhc\" (UID: \"e991381e-f373-488a-94a5-0ab6c4426990\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-gldhc" Jul 06 21:09:27.578261 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:09:27.578221 2563 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 06 21:09:27.578340 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:09:27.578286 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e991381e-f373-488a-94a5-0ab6c4426990-monitoring-plugin-cert podName:e991381e-f373-488a-94a5-0ab6c4426990 nodeName:}" failed. No retries permitted until 2026-07-06 21:09:28.578270459 +0000 UTC m=+315.096508573 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/e991381e-f373-488a-94a5-0ab6c4426990-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-gldhc" (UID: "e991381e-f373-488a-94a5-0ab6c4426990") : secret "monitoring-plugin-cert" not found Jul 06 21:09:28.084195 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.084156 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-566b589849-2pnvd" event={"ID":"5ef5f50a-f6ea-4456-8f52-e88a513d37ef","Type":"ContainerStarted","Data":"98e2f75d33cce13152c9d7e232ec8b958cb2e36ac183a522df7938c7866771c3"} Jul 06 21:09:28.084639 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.084268 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-566b589849-2pnvd" event={"ID":"5ef5f50a-f6ea-4456-8f52-e88a513d37ef","Type":"ContainerStarted","Data":"f315b762b70462ff12b69b1b51cee53b879e63ccc476949f177622395ace7590"} Jul 06 21:09:28.084639 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.084297 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-566b589849-2pnvd" event={"ID":"5ef5f50a-f6ea-4456-8f52-e88a513d37ef","Type":"ContainerStarted","Data":"a6ebd759622f547ee94714e4743b2dddb029b735d59e833a21b5988892eccf75"} Jul 06 21:09:28.296815 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.296780 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 21:09:28.301425 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.301403 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.306353 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.306327 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 06 21:09:28.306489 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.306459 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 06 21:09:28.306724 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.306702 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 06 21:09:28.306868 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.306847 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 06 21:09:28.307709 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.307666 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-lg8vb\"" Jul 06 21:09:28.307709 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.307680 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6t59hsook5cm2\"" Jul 06 21:09:28.308459 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.307735 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 06 21:09:28.308459 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.307756 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 06 21:09:28.308459 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.308035 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 06 21:09:28.308459 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.308154 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 06 21:09:28.308459 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.308198 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 06 21:09:28.308459 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.308220 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 06 21:09:28.308459 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.308274 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 06 21:09:28.308459 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.308307 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 06 21:09:28.309512 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.308861 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 06 21:09:28.310577 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.310396 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 06 21:09:28.316854 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.316832 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 21:09:28.385402 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.385372 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd7039df-08e3-4fef-9c16-26dcf1e29992-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.385660 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.385412 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cd7039df-08e3-4fef-9c16-26dcf1e29992-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.385660 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.385477 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cd7039df-08e3-4fef-9c16-26dcf1e29992-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.385660 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.385508 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd7039df-08e3-4fef-9c16-26dcf1e29992-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.385660 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.385544 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cd7039df-08e3-4fef-9c16-26dcf1e29992-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.385660 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.385604 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzwj6\" (UniqueName: \"kubernetes.io/projected/cd7039df-08e3-4fef-9c16-26dcf1e29992-kube-api-access-zzwj6\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.385856 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.385694 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cd7039df-08e3-4fef-9c16-26dcf1e29992-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.385856 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.385731 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cd7039df-08e3-4fef-9c16-26dcf1e29992-config-out\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.385856 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.385764 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cd7039df-08e3-4fef-9c16-26dcf1e29992-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.385856 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.385794 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd7039df-08e3-4fef-9c16-26dcf1e29992-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.386002 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.385869 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cd7039df-08e3-4fef-9c16-26dcf1e29992-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.386002 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.385919 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cd7039df-08e3-4fef-9c16-26dcf1e29992-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.386002 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.385936 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cd7039df-08e3-4fef-9c16-26dcf1e29992-web-config\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.386002 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.385953 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cd7039df-08e3-4fef-9c16-26dcf1e29992-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.386002 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.385971 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd7039df-08e3-4fef-9c16-26dcf1e29992-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.386002 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.385989 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/cd7039df-08e3-4fef-9c16-26dcf1e29992-config\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.386243 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.386022 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cd7039df-08e3-4fef-9c16-26dcf1e29992-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.386243 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.386108 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cd7039df-08e3-4fef-9c16-26dcf1e29992-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.386243 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.386167 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cd7039df-08e3-4fef-9c16-26dcf1e29992-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.386243 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.386219 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cd7039df-08e3-4fef-9c16-26dcf1e29992-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.486851 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.486810 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/cd7039df-08e3-4fef-9c16-26dcf1e29992-config\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.487048 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.486860 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cd7039df-08e3-4fef-9c16-26dcf1e29992-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.487048 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.486910 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cd7039df-08e3-4fef-9c16-26dcf1e29992-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.487048 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.486961 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cd7039df-08e3-4fef-9c16-26dcf1e29992-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.487048 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.486990 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cd7039df-08e3-4fef-9c16-26dcf1e29992-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.487048 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.487035 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd7039df-08e3-4fef-9c16-26dcf1e29992-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.487307 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.487059 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cd7039df-08e3-4fef-9c16-26dcf1e29992-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.487307 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.487101 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cd7039df-08e3-4fef-9c16-26dcf1e29992-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.487307 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.487126 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd7039df-08e3-4fef-9c16-26dcf1e29992-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.487307 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.487159 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cd7039df-08e3-4fef-9c16-26dcf1e29992-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.487307 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.487182 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzwj6\" (UniqueName: \"kubernetes.io/projected/cd7039df-08e3-4fef-9c16-26dcf1e29992-kube-api-access-zzwj6\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.487307 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.487223 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cd7039df-08e3-4fef-9c16-26dcf1e29992-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.487307 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.487248 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cd7039df-08e3-4fef-9c16-26dcf1e29992-config-out\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.487307 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.487277 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cd7039df-08e3-4fef-9c16-26dcf1e29992-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.487307 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.487306 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd7039df-08e3-4fef-9c16-26dcf1e29992-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.487753 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.487696 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cd7039df-08e3-4fef-9c16-26dcf1e29992-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.488036 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.488003 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd7039df-08e3-4fef-9c16-26dcf1e29992-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.488174 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.488049 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd7039df-08e3-4fef-9c16-26dcf1e29992-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.488888 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.488862 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd7039df-08e3-4fef-9c16-26dcf1e29992-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.488993 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.488950 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cd7039df-08e3-4fef-9c16-26dcf1e29992-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.488993 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.488989 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cd7039df-08e3-4fef-9c16-26dcf1e29992-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.489105 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.489015 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cd7039df-08e3-4fef-9c16-26dcf1e29992-web-config\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.489105 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.489042 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cd7039df-08e3-4fef-9c16-26dcf1e29992-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.489105 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.489073 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd7039df-08e3-4fef-9c16-26dcf1e29992-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.489866 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.489840 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd7039df-08e3-4fef-9c16-26dcf1e29992-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.491059 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.490548 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cd7039df-08e3-4fef-9c16-26dcf1e29992-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.491059 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.490561 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cd7039df-08e3-4fef-9c16-26dcf1e29992-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.491059 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.490735 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cd7039df-08e3-4fef-9c16-26dcf1e29992-config-out\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.491059 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.490870 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cd7039df-08e3-4fef-9c16-26dcf1e29992-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.491059 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.491034 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cd7039df-08e3-4fef-9c16-26dcf1e29992-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.491440 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.491420 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cd7039df-08e3-4fef-9c16-26dcf1e29992-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.491899 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.491856 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cd7039df-08e3-4fef-9c16-26dcf1e29992-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.491899 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.491872 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cd7039df-08e3-4fef-9c16-26dcf1e29992-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.492035 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.491900 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/cd7039df-08e3-4fef-9c16-26dcf1e29992-config\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.493076 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.493041 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cd7039df-08e3-4fef-9c16-26dcf1e29992-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.493365 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.493295 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cd7039df-08e3-4fef-9c16-26dcf1e29992-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.494609 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.494560 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cd7039df-08e3-4fef-9c16-26dcf1e29992-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.494704 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.494666 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cd7039df-08e3-4fef-9c16-26dcf1e29992-web-config\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.494922 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.494900 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cd7039df-08e3-4fef-9c16-26dcf1e29992-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.498648 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.498627 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzwj6\" (UniqueName: \"kubernetes.io/projected/cd7039df-08e3-4fef-9c16-26dcf1e29992-kube-api-access-zzwj6\") pod \"prometheus-k8s-0\" (UID: \"cd7039df-08e3-4fef-9c16-26dcf1e29992\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.589816 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.589778 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e991381e-f373-488a-94a5-0ab6c4426990-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-gldhc\" (UID: \"e991381e-f373-488a-94a5-0ab6c4426990\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-gldhc" Jul 06 21:09:28.592499 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.592471 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e991381e-f373-488a-94a5-0ab6c4426990-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-gldhc\" (UID: \"e991381e-f373-488a-94a5-0ab6c4426990\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-gldhc" Jul 06 21:09:28.612984 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.612955 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:28.718373 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:28.718290 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-gldhc" Jul 06 21:09:29.248696 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:29.248441 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-65d484654d-d45tf" Jul 06 21:09:29.396246 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:29.396222 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 21:09:29.399703 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:09:29.399673 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd7039df_08e3_4fef_9c16_26dcf1e29992.slice/crio-4a85f0bedab6e918bd38d96e66fa30a47e706e03d8f3e9a82628f05a079faa99 WatchSource:0}: Error finding container 4a85f0bedab6e918bd38d96e66fa30a47e706e03d8f3e9a82628f05a079faa99: Status 404 returned error can't find the container with id 4a85f0bedab6e918bd38d96e66fa30a47e706e03d8f3e9a82628f05a079faa99 Jul 06 21:09:29.406166 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:29.406097 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-gldhc"] Jul 06 21:09:29.408159 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:09:29.408135 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode991381e_f373_488a_94a5_0ab6c4426990.slice/crio-5489e5df87f0f542af42c36d381439a2afe8c9c78b7c6921dfaa78200afeb4ca WatchSource:0}: Error finding container 5489e5df87f0f542af42c36d381439a2afe8c9c78b7c6921dfaa78200afeb4ca: Status 404 returned error can't find the container with id 5489e5df87f0f542af42c36d381439a2afe8c9c78b7c6921dfaa78200afeb4ca Jul 06 21:09:30.100842 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:30.100747 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bb827a5a-a187-4169-9b6c-3f8d7d6db6ce","Type":"ContainerStarted","Data":"ddd798c46f0978f2d1c8504edcd6530a3c8f82f64bb2a98ba2d9acc84da55ac5"} Jul 06 21:09:30.100842 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:30.100829 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bb827a5a-a187-4169-9b6c-3f8d7d6db6ce","Type":"ContainerStarted","Data":"b13a0fd1940e4f28a693db258ed03af0e82d73cc252efc346b5c5a87328683bb"} Jul 06 21:09:30.101065 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:30.100867 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bb827a5a-a187-4169-9b6c-3f8d7d6db6ce","Type":"ContainerStarted","Data":"14be25ab7d3828aa8000ee1893e35dde5a92db79ea0573c75dad617780d605a5"} Jul 06 21:09:30.101065 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:30.100937 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bb827a5a-a187-4169-9b6c-3f8d7d6db6ce","Type":"ContainerStarted","Data":"49a749682f352e9ca722f1160ef61a15e80e23b12d429a03a5eaacd0c07b9c02"} Jul 06 21:09:30.101065 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:30.100976 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bb827a5a-a187-4169-9b6c-3f8d7d6db6ce","Type":"ContainerStarted","Data":"d56e238e209351940eb0786a3c6596245c04a4c73d55bd29f0e30cdade40ea7e"} Jul 06 21:09:30.101065 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:30.101010 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bb827a5a-a187-4169-9b6c-3f8d7d6db6ce","Type":"ContainerStarted","Data":"1493121691c9011de9fcf9d52e230e494d3ac3f9fe043e8afafbfdef12aa869b"} Jul 06 21:09:30.102230 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:30.102202 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-gldhc" event={"ID":"e991381e-f373-488a-94a5-0ab6c4426990","Type":"ContainerStarted","Data":"5489e5df87f0f542af42c36d381439a2afe8c9c78b7c6921dfaa78200afeb4ca"} Jul 06 21:09:30.104977 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:30.104929 2563 generic.go:356] "Generic (PLEG): container finished" podID="cd7039df-08e3-4fef-9c16-26dcf1e29992" containerID="1b78fffae4229b470ac7060468885797488f693b85c6fe9a5f0f96a5d86513eb" exitCode=0 Jul 06 21:09:30.105679 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:30.105260 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cd7039df-08e3-4fef-9c16-26dcf1e29992","Type":"ContainerDied","Data":"1b78fffae4229b470ac7060468885797488f693b85c6fe9a5f0f96a5d86513eb"} Jul 06 21:09:30.105679 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:30.105341 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cd7039df-08e3-4fef-9c16-26dcf1e29992","Type":"ContainerStarted","Data":"4a85f0bedab6e918bd38d96e66fa30a47e706e03d8f3e9a82628f05a079faa99"} Jul 06 21:09:30.108997 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:30.108944 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-69bc7f949b-gksxt" event={"ID":"2dbbcfaa-9d5d-4185-b92c-b56ad201875c","Type":"ContainerStarted","Data":"900f737b42343577be63306fd9ecc6622fd2533754f949fde4dc1735d264b5c9"} Jul 06 21:09:30.112512 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:30.112374 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-566b589849-2pnvd" event={"ID":"5ef5f50a-f6ea-4456-8f52-e88a513d37ef","Type":"ContainerStarted","Data":"8e166aa72ba3c8402647ebd95b4765ab907c75c2f298798aafdd98cfb6a366d2"} Jul 06 21:09:30.112512 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:30.112442 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-566b589849-2pnvd" event={"ID":"5ef5f50a-f6ea-4456-8f52-e88a513d37ef","Type":"ContainerStarted","Data":"f6092cc18dc124c03ecd323c8d84d3c18eb6e3376e40b3b40f942cd7d2afed85"} Jul 06 21:09:30.112512 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:30.112484 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-566b589849-2pnvd" event={"ID":"5ef5f50a-f6ea-4456-8f52-e88a513d37ef","Type":"ContainerStarted","Data":"c4b41dbfae77fffdf5d4f7781135ae1978fc191035314e319c04d726164906d3"} Jul 06 21:09:30.112687 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:30.112529 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-566b589849-2pnvd" Jul 06 21:09:30.127810 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:30.127701 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.7521073940000003 podStartE2EDuration="7.127684409s" totalImagesPullingTime="4.35542666s" totalInitContainerRuntime="20.150355ms" isStatefulPod=false podCreationTimestamp="2026-07-06 21:09:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:09:30.12611608 +0000 UTC m=+316.644354273" watchObservedRunningTime="2026-07-06 21:09:30.127684409 +0000 UTC m=+316.645922541" Jul 06 21:09:30.144117 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:30.144065 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-69bc7f949b-gksxt" podStartSLOduration=1.9295084519999999 podStartE2EDuration="4.144050699s" totalImagesPullingTime="2.214542247s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:09:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:09:30.143952761 +0000 UTC m=+316.662190919" watchObservedRunningTime="2026-07-06 21:09:30.144050699 +0000 UTC m=+316.662288828" Jul 06 21:09:30.194059 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:30.194012 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-566b589849-2pnvd" podStartSLOduration=1.860160061 podStartE2EDuration="6.193998272s" totalImagesPullingTime="4.333838211s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:09:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:09:30.193415363 +0000 UTC m=+316.711653524" watchObservedRunningTime="2026-07-06 21:09:30.193998272 +0000 UTC m=+316.712236404" Jul 06 21:09:31.120161 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:31.119826 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-gldhc" event={"ID":"e991381e-f373-488a-94a5-0ab6c4426990","Type":"ContainerStarted","Data":"1c6c029ad026cfe0707b47cb011519052427c7ed5b6690f04f4e0cc86b982578"} Jul 06 21:09:31.120825 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:31.120738 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-gldhc" Jul 06 21:09:31.126112 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:31.126087 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-gldhc" Jul 06 21:09:31.135896 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:31.135850 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-gldhc" podStartSLOduration=3.623920009 podStartE2EDuration="5.135835978s" totalImagesPullingTime="1.511915969s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:09:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:09:31.134282866 +0000 UTC m=+317.652520997" watchObservedRunningTime="2026-07-06 21:09:31.135835978 +0000 UTC m=+317.654074160" Jul 06 21:09:35.140212 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:35.140172 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cd7039df-08e3-4fef-9c16-26dcf1e29992","Type":"ContainerStarted","Data":"c98dc2cd0b3b36eadacc3e249315892492a14c485cd03c119004acc2e626e7ab"} Jul 06 21:09:35.140618 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:35.140282 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cd7039df-08e3-4fef-9c16-26dcf1e29992","Type":"ContainerStarted","Data":"edc5486438535647cb58f8aa6751f226c0537e25280dc84e5ee5e4be8f5ede15"} Jul 06 21:09:35.140618 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:35.140335 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cd7039df-08e3-4fef-9c16-26dcf1e29992","Type":"ContainerStarted","Data":"67a7281d2ea35ad2255fa50ebfa0b4677f38fb89a31fe36b8c930acbbdd333f4"} Jul 06 21:09:35.140618 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:35.140374 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cd7039df-08e3-4fef-9c16-26dcf1e29992","Type":"ContainerStarted","Data":"5ac880b2f602bb3a3bf9bc62ed0de4121059f2fbbeba85e9a75358ad9c320b3c"} Jul 06 21:09:35.140618 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:35.140406 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cd7039df-08e3-4fef-9c16-26dcf1e29992","Type":"ContainerStarted","Data":"daad10bdc15516b0d32d39b37698340466cb871e9937d608a2b3013a98159a47"} Jul 06 21:09:35.140618 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:35.140430 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cd7039df-08e3-4fef-9c16-26dcf1e29992","Type":"ContainerStarted","Data":"d4424f57f3f924294fbda44ba85da47da3b38d02854f408f3cbbf0ec7a52714f"} Jul 06 21:09:35.166217 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:35.166168 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.555953921 podStartE2EDuration="7.16615299s" totalImagesPullingTime="4.58579193s" totalInitContainerRuntime="24.407139ms" isStatefulPod=false podCreationTimestamp="2026-07-06 21:09:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:09:35.16417797 +0000 UTC m=+321.682416129" watchObservedRunningTime="2026-07-06 21:09:35.16615299 +0000 UTC m=+321.684391121" Jul 06 21:09:36.127520 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:36.127490 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-566b589849-2pnvd" Jul 06 21:09:38.613430 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:38.613396 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:09:42.856786 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:42.856753 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-846c49bc6f-hq8g2"] Jul 06 21:09:44.259414 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:44.259340 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-65d484654d-d45tf" podUID="21e6ad8b-efe9-4faf-a400-e1014c3dfbb5" containerName="registry" containerID="cri-o://7195903071a514d1dbb972b0f4e3141d930045b6834e1525baa366e45e9a1f4b" gracePeriod=30 Jul 06 21:09:44.511032 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:44.510973 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65d484654d-d45tf" Jul 06 21:09:44.654910 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:44.654877 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-registry-tls\") pod \"21e6ad8b-efe9-4faf-a400-e1014c3dfbb5\" (UID: \"21e6ad8b-efe9-4faf-a400-e1014c3dfbb5\") " Jul 06 21:09:44.654910 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:44.654918 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-bound-sa-token\") pod \"21e6ad8b-efe9-4faf-a400-e1014c3dfbb5\" (UID: \"21e6ad8b-efe9-4faf-a400-e1014c3dfbb5\") " Jul 06 21:09:44.655140 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:44.654945 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2v4t7\" (UniqueName: \"kubernetes.io/projected/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-kube-api-access-2v4t7\") pod \"21e6ad8b-efe9-4faf-a400-e1014c3dfbb5\" (UID: \"21e6ad8b-efe9-4faf-a400-e1014c3dfbb5\") " Jul 06 21:09:44.655140 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:44.655001 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-registry-certificates\") pod \"21e6ad8b-efe9-4faf-a400-e1014c3dfbb5\" (UID: \"21e6ad8b-efe9-4faf-a400-e1014c3dfbb5\") " Jul 06 21:09:44.655140 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:44.655032 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-trusted-ca\") pod \"21e6ad8b-efe9-4faf-a400-e1014c3dfbb5\" (UID: \"21e6ad8b-efe9-4faf-a400-e1014c3dfbb5\") " Jul 06 21:09:44.655140 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:44.655053 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-installation-pull-secrets\") pod \"21e6ad8b-efe9-4faf-a400-e1014c3dfbb5\" (UID: \"21e6ad8b-efe9-4faf-a400-e1014c3dfbb5\") " Jul 06 21:09:44.655140 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:44.655089 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-ca-trust-extracted\") pod \"21e6ad8b-efe9-4faf-a400-e1014c3dfbb5\" (UID: \"21e6ad8b-efe9-4faf-a400-e1014c3dfbb5\") " Jul 06 21:09:44.655140 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:44.655120 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-image-registry-private-configuration\") pod \"21e6ad8b-efe9-4faf-a400-e1014c3dfbb5\" (UID: \"21e6ad8b-efe9-4faf-a400-e1014c3dfbb5\") " Jul 06 21:09:44.655681 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:44.655606 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "21e6ad8b-efe9-4faf-a400-e1014c3dfbb5" (UID: "21e6ad8b-efe9-4faf-a400-e1014c3dfbb5"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 21:09:44.655810 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:44.655720 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "21e6ad8b-efe9-4faf-a400-e1014c3dfbb5" (UID: "21e6ad8b-efe9-4faf-a400-e1014c3dfbb5"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 21:09:44.657622 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:44.657584 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-kube-api-access-2v4t7" (OuterVolumeSpecName: "kube-api-access-2v4t7") pod "21e6ad8b-efe9-4faf-a400-e1014c3dfbb5" (UID: "21e6ad8b-efe9-4faf-a400-e1014c3dfbb5"). InnerVolumeSpecName "kube-api-access-2v4t7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 21:09:44.657622 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:44.657584 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "21e6ad8b-efe9-4faf-a400-e1014c3dfbb5" (UID: "21e6ad8b-efe9-4faf-a400-e1014c3dfbb5"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 21:09:44.657909 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:44.657884 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "21e6ad8b-efe9-4faf-a400-e1014c3dfbb5" (UID: "21e6ad8b-efe9-4faf-a400-e1014c3dfbb5"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 21:09:44.658012 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:44.657918 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "21e6ad8b-efe9-4faf-a400-e1014c3dfbb5" (UID: "21e6ad8b-efe9-4faf-a400-e1014c3dfbb5"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 21:09:44.658012 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:44.657926 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "21e6ad8b-efe9-4faf-a400-e1014c3dfbb5" (UID: "21e6ad8b-efe9-4faf-a400-e1014c3dfbb5"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 21:09:44.664419 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:44.664306 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "21e6ad8b-efe9-4faf-a400-e1014c3dfbb5" (UID: "21e6ad8b-efe9-4faf-a400-e1014c3dfbb5"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 21:09:44.756534 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:44.756496 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-trusted-ca\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\"" Jul 06 21:09:44.756534 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:44.756532 2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-installation-pull-secrets\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\"" Jul 06 21:09:44.756534 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:44.756542 2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-ca-trust-extracted\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\"" Jul 06 21:09:44.756777 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:44.756552 2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-image-registry-private-configuration\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\"" Jul 06 21:09:44.756777 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:44.756562 2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-registry-tls\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\"" Jul 06 21:09:44.756777 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:44.756571 2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-bound-sa-token\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\"" Jul 06 21:09:44.756777 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:44.756579 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2v4t7\" (UniqueName: \"kubernetes.io/projected/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-kube-api-access-2v4t7\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\"" Jul 06 21:09:44.756777 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:44.756586 2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5-registry-certificates\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\"" Jul 06 21:09:45.185872 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:45.185839 2563 generic.go:356] "Generic (PLEG): container finished" podID="21e6ad8b-efe9-4faf-a400-e1014c3dfbb5" containerID="7195903071a514d1dbb972b0f4e3141d930045b6834e1525baa366e45e9a1f4b" exitCode=0 Jul 06 21:09:45.186043 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:45.185885 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65d484654d-d45tf" Jul 06 21:09:45.186043 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:45.185928 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65d484654d-d45tf" event={"ID":"21e6ad8b-efe9-4faf-a400-e1014c3dfbb5","Type":"ContainerDied","Data":"7195903071a514d1dbb972b0f4e3141d930045b6834e1525baa366e45e9a1f4b"} Jul 06 21:09:45.186043 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:45.185977 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65d484654d-d45tf" event={"ID":"21e6ad8b-efe9-4faf-a400-e1014c3dfbb5","Type":"ContainerDied","Data":"df2eedab27a02d951461f3687694154768577954ccb2c473ecd3b16abbc1f07f"} Jul 06 21:09:45.186043 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:45.185998 2563 scope.go:117] "RemoveContainer" containerID="7195903071a514d1dbb972b0f4e3141d930045b6834e1525baa366e45e9a1f4b" Jul 06 21:09:45.194951 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:45.194933 2563 scope.go:117] "RemoveContainer" containerID="7195903071a514d1dbb972b0f4e3141d930045b6834e1525baa366e45e9a1f4b" Jul 06 21:09:45.195191 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:09:45.195160 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7195903071a514d1dbb972b0f4e3141d930045b6834e1525baa366e45e9a1f4b\": container with ID starting with 7195903071a514d1dbb972b0f4e3141d930045b6834e1525baa366e45e9a1f4b not found: ID does not exist" containerID="7195903071a514d1dbb972b0f4e3141d930045b6834e1525baa366e45e9a1f4b" Jul 06 21:09:45.195234 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:45.195199 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7195903071a514d1dbb972b0f4e3141d930045b6834e1525baa366e45e9a1f4b"} err="failed to get container status \"7195903071a514d1dbb972b0f4e3141d930045b6834e1525baa366e45e9a1f4b\": rpc error: code = NotFound desc = could not find container \"7195903071a514d1dbb972b0f4e3141d930045b6834e1525baa366e45e9a1f4b\": container with ID starting with 7195903071a514d1dbb972b0f4e3141d930045b6834e1525baa366e45e9a1f4b not found: ID does not exist" Jul 06 21:09:45.205898 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:45.205876 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-65d484654d-d45tf"] Jul 06 21:09:45.210074 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:45.210051 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-65d484654d-d45tf"] Jul 06 21:09:46.034874 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:46.034833 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21e6ad8b-efe9-4faf-a400-e1014c3dfbb5" path="/var/lib/kubelet/pods/21e6ad8b-efe9-4faf-a400-e1014c3dfbb5/volumes" Jul 06 21:09:46.675392 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:46.675358 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-69bc7f949b-gksxt" Jul 06 21:09:46.675574 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:46.675419 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-69bc7f949b-gksxt" Jul 06 21:09:51.213686 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:51.213653 2563 generic.go:356] "Generic (PLEG): container finished" podID="e6c752c6-9cfb-4761-b7ce-ca3e2d37e6a2" containerID="2ea735230de7dcc8f31b407bc45b3dc061094e3f08dcb0f89595ea06d56e7fec" exitCode=0 Jul 06 21:09:51.214064 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:51.213679 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-vsz75" event={"ID":"e6c752c6-9cfb-4761-b7ce-ca3e2d37e6a2","Type":"ContainerDied","Data":"2ea735230de7dcc8f31b407bc45b3dc061094e3f08dcb0f89595ea06d56e7fec"} Jul 06 21:09:51.214064 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:51.214048 2563 scope.go:117] "RemoveContainer" containerID="2ea735230de7dcc8f31b407bc45b3dc061094e3f08dcb0f89595ea06d56e7fec" Jul 06 21:09:51.215531 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:51.215511 2563 generic.go:356] "Generic (PLEG): container finished" podID="826404fc-09bb-44da-bd6a-3d071e3009c8" containerID="cde793ecee86dec405c4dec0d132d7692bc51e2f281402622758cd0aaf1611d7" exitCode=0 Jul 06 21:09:51.215613 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:51.215588 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vcp8r" event={"ID":"826404fc-09bb-44da-bd6a-3d071e3009c8","Type":"ContainerDied","Data":"cde793ecee86dec405c4dec0d132d7692bc51e2f281402622758cd0aaf1611d7"} Jul 06 21:09:51.215884 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:51.215869 2563 scope.go:117] "RemoveContainer" containerID="cde793ecee86dec405c4dec0d132d7692bc51e2f281402622758cd0aaf1611d7" Jul 06 21:09:52.221665 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:52.221630 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-vsz75" event={"ID":"e6c752c6-9cfb-4761-b7ce-ca3e2d37e6a2","Type":"ContainerStarted","Data":"bc8c9921ccfe0a295be5a8a11a757845055b6ea978a3c8bdab30e74d0bd3dfe0"} Jul 06 21:09:52.223443 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:09:52.223415 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vcp8r" event={"ID":"826404fc-09bb-44da-bd6a-3d071e3009c8","Type":"ContainerStarted","Data":"18719b719c486b7084588484181d08e5c77489f064e53f7b9b3aa019cd24e201"} Jul 06 21:10:06.288058 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:10:06.286768 2563 generic.go:356] "Generic (PLEG): container finished" podID="d8331c1e-5061-4874-9338-e9daf1c79b83" containerID="a9ba3e2afd8ab7c5b187fb7e2425252f2c0d3efee9794560ca6c71fc3529acdc" exitCode=0 Jul 06 21:10:06.288058 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:10:06.286929 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-z727m" event={"ID":"d8331c1e-5061-4874-9338-e9daf1c79b83","Type":"ContainerDied","Data":"a9ba3e2afd8ab7c5b187fb7e2425252f2c0d3efee9794560ca6c71fc3529acdc"} Jul 06 21:10:06.288058 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:10:06.287330 2563 scope.go:117] "RemoveContainer" containerID="a9ba3e2afd8ab7c5b187fb7e2425252f2c0d3efee9794560ca6c71fc3529acdc" Jul 06 21:10:06.681472 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:10:06.681446 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-69bc7f949b-gksxt" Jul 06 21:10:06.685916 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:10:06.685882 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-69bc7f949b-gksxt" Jul 06 21:10:07.292559 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:10:07.292513 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-z727m" event={"ID":"d8331c1e-5061-4874-9338-e9daf1c79b83","Type":"ContainerStarted","Data":"102d5a6d62ffe80d171135d5f3f9c547377c4a831927767b98f3d35738ab328b"} Jul 06 21:10:07.879490 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:10:07.879424 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-846c49bc6f-hq8g2" podUID="56589b7e-e251-4b7a-a8e7-48c90ab765ed" containerName="console" containerID="cri-o://bf6bc20308bd9df2ef541a480a8398999ff3af48105aee2652f62c172a0606cc" gracePeriod=15 Jul 06 21:10:08.130898 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:10:08.130845 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-846c49bc6f-hq8g2" Jul 06 21:10:08.190221 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:10:08.190186 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/56589b7e-e251-4b7a-a8e7-48c90ab765ed-service-ca\") pod \"56589b7e-e251-4b7a-a8e7-48c90ab765ed\" (UID: \"56589b7e-e251-4b7a-a8e7-48c90ab765ed\") " Jul 06 21:10:08.190221 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:10:08.190227 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/56589b7e-e251-4b7a-a8e7-48c90ab765ed-console-config\") pod \"56589b7e-e251-4b7a-a8e7-48c90ab765ed\" (UID: \"56589b7e-e251-4b7a-a8e7-48c90ab765ed\") " Jul 06 21:10:08.190470 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:10:08.190250 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/56589b7e-e251-4b7a-a8e7-48c90ab765ed-console-serving-cert\") pod \"56589b7e-e251-4b7a-a8e7-48c90ab765ed\" (UID: \"56589b7e-e251-4b7a-a8e7-48c90ab765ed\") " Jul 06 21:10:08.190470 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:10:08.190266 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/56589b7e-e251-4b7a-a8e7-48c90ab765ed-console-oauth-config\") pod \"56589b7e-e251-4b7a-a8e7-48c90ab765ed\" (UID: \"56589b7e-e251-4b7a-a8e7-48c90ab765ed\") " Jul 06 21:10:08.190470 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:10:08.190286 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56589b7e-e251-4b7a-a8e7-48c90ab765ed-trusted-ca-bundle\") pod \"56589b7e-e251-4b7a-a8e7-48c90ab765ed\" (UID: \"56589b7e-e251-4b7a-a8e7-48c90ab765ed\") " Jul 06 21:10:08.190470 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:10:08.190349 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/56589b7e-e251-4b7a-a8e7-48c90ab765ed-oauth-serving-cert\") pod \"56589b7e-e251-4b7a-a8e7-48c90ab765ed\" (UID: \"56589b7e-e251-4b7a-a8e7-48c90ab765ed\") " Jul 06 21:10:08.190470 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:10:08.190388 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9fl7q\" (UniqueName: \"kubernetes.io/projected/56589b7e-e251-4b7a-a8e7-48c90ab765ed-kube-api-access-9fl7q\") pod \"56589b7e-e251-4b7a-a8e7-48c90ab765ed\" (UID: \"56589b7e-e251-4b7a-a8e7-48c90ab765ed\") " Jul 06 21:10:08.190761 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:10:08.190709 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56589b7e-e251-4b7a-a8e7-48c90ab765ed-service-ca" (OuterVolumeSpecName: "service-ca") pod "56589b7e-e251-4b7a-a8e7-48c90ab765ed" (UID: "56589b7e-e251-4b7a-a8e7-48c90ab765ed"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 21:10:08.190844 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:10:08.190695 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56589b7e-e251-4b7a-a8e7-48c90ab765ed-console-config" (OuterVolumeSpecName: "console-config") pod "56589b7e-e251-4b7a-a8e7-48c90ab765ed" (UID: "56589b7e-e251-4b7a-a8e7-48c90ab765ed"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 21:10:08.190844 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:10:08.190807 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56589b7e-e251-4b7a-a8e7-48c90ab765ed-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "56589b7e-e251-4b7a-a8e7-48c90ab765ed" (UID: "56589b7e-e251-4b7a-a8e7-48c90ab765ed"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 21:10:08.190929 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:10:08.190877 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56589b7e-e251-4b7a-a8e7-48c90ab765ed-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "56589b7e-e251-4b7a-a8e7-48c90ab765ed" (UID: "56589b7e-e251-4b7a-a8e7-48c90ab765ed"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 21:10:08.192704 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:10:08.192678 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56589b7e-e251-4b7a-a8e7-48c90ab765ed-kube-api-access-9fl7q" (OuterVolumeSpecName: "kube-api-access-9fl7q") pod "56589b7e-e251-4b7a-a8e7-48c90ab765ed" (UID: "56589b7e-e251-4b7a-a8e7-48c90ab765ed"). InnerVolumeSpecName "kube-api-access-9fl7q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 21:10:08.192809 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:10:08.192789 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56589b7e-e251-4b7a-a8e7-48c90ab765ed-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "56589b7e-e251-4b7a-a8e7-48c90ab765ed" (UID: "56589b7e-e251-4b7a-a8e7-48c90ab765ed"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 21:10:08.192857 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:10:08.192835 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56589b7e-e251-4b7a-a8e7-48c90ab765ed-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "56589b7e-e251-4b7a-a8e7-48c90ab765ed" (UID: "56589b7e-e251-4b7a-a8e7-48c90ab765ed"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 21:10:08.291522 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:10:08.291482 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/56589b7e-e251-4b7a-a8e7-48c90ab765ed-service-ca\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\"" Jul 06 21:10:08.291522 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:10:08.291513 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/56589b7e-e251-4b7a-a8e7-48c90ab765ed-console-config\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\"" Jul 06 21:10:08.291522 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:10:08.291523 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/56589b7e-e251-4b7a-a8e7-48c90ab765ed-console-serving-cert\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\"" Jul 06 21:10:08.291522 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:10:08.291533 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/56589b7e-e251-4b7a-a8e7-48c90ab765ed-console-oauth-config\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\"" Jul 06 21:10:08.291786 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:10:08.291542 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56589b7e-e251-4b7a-a8e7-48c90ab765ed-trusted-ca-bundle\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\"" Jul 06 21:10:08.291786 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:10:08.291551 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/56589b7e-e251-4b7a-a8e7-48c90ab765ed-oauth-serving-cert\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\"" Jul 06 21:10:08.291786 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:10:08.291559 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9fl7q\" (UniqueName: \"kubernetes.io/projected/56589b7e-e251-4b7a-a8e7-48c90ab765ed-kube-api-access-9fl7q\") on node \"ip-10-0-131-182.ec2.internal\" DevicePath \"\"" Jul 06 21:10:08.298242 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:10:08.298211 2563 generic.go:356] "Generic (PLEG): container finished" podID="56589b7e-e251-4b7a-a8e7-48c90ab765ed" containerID="bf6bc20308bd9df2ef541a480a8398999ff3af48105aee2652f62c172a0606cc" exitCode=0 Jul 06 21:10:08.298677 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:10:08.298260 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-846c49bc6f-hq8g2" Jul 06 21:10:08.298677 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:10:08.298259 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-846c49bc6f-hq8g2" event={"ID":"56589b7e-e251-4b7a-a8e7-48c90ab765ed","Type":"ContainerDied","Data":"bf6bc20308bd9df2ef541a480a8398999ff3af48105aee2652f62c172a0606cc"} Jul 06 21:10:08.298677 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:10:08.298408 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-846c49bc6f-hq8g2" event={"ID":"56589b7e-e251-4b7a-a8e7-48c90ab765ed","Type":"ContainerDied","Data":"2ae3afd3b94fbc9565f042a87ee4326f15d7083787e2a939e98a5dfcd182bcfd"} Jul 06 21:10:08.298677 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:10:08.298445 2563 scope.go:117] "RemoveContainer" containerID="bf6bc20308bd9df2ef541a480a8398999ff3af48105aee2652f62c172a0606cc" Jul 06 21:10:08.307516 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:10:08.307497 2563 scope.go:117] "RemoveContainer" containerID="bf6bc20308bd9df2ef541a480a8398999ff3af48105aee2652f62c172a0606cc" Jul 06 21:10:08.307783 ip-10-0-131-182 kubenswrapper[2563]: E0706 21:10:08.307759 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf6bc20308bd9df2ef541a480a8398999ff3af48105aee2652f62c172a0606cc\": container with ID starting with bf6bc20308bd9df2ef541a480a8398999ff3af48105aee2652f62c172a0606cc not found: ID does not exist" containerID="bf6bc20308bd9df2ef541a480a8398999ff3af48105aee2652f62c172a0606cc" Jul 06 21:10:08.307865 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:10:08.307791 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf6bc20308bd9df2ef541a480a8398999ff3af48105aee2652f62c172a0606cc"} err="failed to get container status \"bf6bc20308bd9df2ef541a480a8398999ff3af48105aee2652f62c172a0606cc\": rpc error: code = NotFound desc = could not find container \"bf6bc20308bd9df2ef541a480a8398999ff3af48105aee2652f62c172a0606cc\": container with ID starting with bf6bc20308bd9df2ef541a480a8398999ff3af48105aee2652f62c172a0606cc not found: ID does not exist" Jul 06 21:10:08.319429 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:10:08.319392 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-846c49bc6f-hq8g2"] Jul 06 21:10:08.323145 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:10:08.323120 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-846c49bc6f-hq8g2"] Jul 06 21:10:10.034468 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:10:10.034437 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56589b7e-e251-4b7a-a8e7-48c90ab765ed" path="/var/lib/kubelet/pods/56589b7e-e251-4b7a-a8e7-48c90ab765ed/volumes" Jul 06 21:10:28.179988 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:10:28.179944 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/084dc07e-e49b-44e3-95cc-11e11c5037a5-metrics-certs\") pod \"network-metrics-daemon-c795j\" (UID: \"084dc07e-e49b-44e3-95cc-11e11c5037a5\") " pod="openshift-multus/network-metrics-daemon-c795j" Jul 06 21:10:28.182370 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:10:28.182340 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/084dc07e-e49b-44e3-95cc-11e11c5037a5-metrics-certs\") pod \"network-metrics-daemon-c795j\" (UID: \"084dc07e-e49b-44e3-95cc-11e11c5037a5\") " pod="openshift-multus/network-metrics-daemon-c795j" Jul 06 21:10:28.432047 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:10:28.431954 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s8xqr\"" Jul 06 21:10:28.440454 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:10:28.440428 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c795j" Jul 06 21:10:28.574267 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:10:28.574230 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-c795j"] Jul 06 21:10:28.577393 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:10:28.577362 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod084dc07e_e49b_44e3_95cc_11e11c5037a5.slice/crio-6fcdf1b640f6911dbf0d89f8c67beb957b4cc2d442bef669a13ab5bbd63b37cb WatchSource:0}: Error finding container 6fcdf1b640f6911dbf0d89f8c67beb957b4cc2d442bef669a13ab5bbd63b37cb: Status 404 returned error can't find the container with id 6fcdf1b640f6911dbf0d89f8c67beb957b4cc2d442bef669a13ab5bbd63b37cb Jul 06 21:10:28.613158 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:10:28.613117 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:10:28.632851 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:10:28.632822 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:10:29.386393 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:10:29.386304 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-c795j" event={"ID":"084dc07e-e49b-44e3-95cc-11e11c5037a5","Type":"ContainerStarted","Data":"6fcdf1b640f6911dbf0d89f8c67beb957b4cc2d442bef669a13ab5bbd63b37cb"} Jul 06 21:10:29.405007 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:10:29.404982 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 21:10:30.392585 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:10:30.392548 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-c795j" event={"ID":"084dc07e-e49b-44e3-95cc-11e11c5037a5","Type":"ContainerStarted","Data":"959b3bbdd9861f0da0d119313c74192dfd4f344ed36771c6ebb1d13a643b970e"} Jul 06 21:10:30.393065 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:10:30.392608 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-c795j" event={"ID":"084dc07e-e49b-44e3-95cc-11e11c5037a5","Type":"ContainerStarted","Data":"2ad41030462e45f4da96b261b56390920ccc5be03d927f2dfbcb28b2924fb6c5"} Jul 06 21:10:30.410084 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:10:30.410035 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-c795j" podStartSLOduration=375.263197413 podStartE2EDuration="6m16.410020259s" totalImagesPullingTime="1.146822846s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:04:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:10:30.407741742 +0000 UTC m=+376.925979885" watchObservedRunningTime="2026-07-06 21:10:30.410020259 +0000 UTC m=+376.928258388" Jul 06 21:12:01.697712 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:01.697680 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vhsmf_a1dc41f0-1699-4e7b-bebc-15f2494d9d23/global-pull-secret-syncer/0.log" Jul 06 21:12:01.826441 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:01.826394 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-x7g5w_a58f0fcd-7bf3-4366-b3b2-622f57f9253b/konnectivity-agent/0.log" Jul 06 21:12:01.873993 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:01.873963 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-182.ec2.internal_0d48b88b816a78be0b1d9723b38c9f11/haproxy/0.log" Jul 06 21:12:05.297760 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:05.297734 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bb827a5a-a187-4169-9b6c-3f8d7d6db6ce/alertmanager/0.log" Jul 06 21:12:05.328455 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:05.328426 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bb827a5a-a187-4169-9b6c-3f8d7d6db6ce/config-reloader/0.log" Jul 06 21:12:05.357605 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:05.357574 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bb827a5a-a187-4169-9b6c-3f8d7d6db6ce/kube-rbac-proxy-web/0.log" Jul 06 21:12:05.385584 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:05.385541 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bb827a5a-a187-4169-9b6c-3f8d7d6db6ce/kube-rbac-proxy/0.log" Jul 06 21:12:05.412570 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:05.412545 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bb827a5a-a187-4169-9b6c-3f8d7d6db6ce/kube-rbac-proxy-metric/0.log" Jul 06 21:12:05.435491 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:05.435444 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bb827a5a-a187-4169-9b6c-3f8d7d6db6ce/prom-label-proxy/0.log" Jul 06 21:12:05.457879 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:05.457841 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bb827a5a-a187-4169-9b6c-3f8d7d6db6ce/init-config-reloader/0.log" Jul 06 21:12:05.503906 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:05.503831 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-hcx9k_f34a6f22-ec93-487d-92c1-b878b40f217e/cluster-monitoring-operator/0.log" Jul 06 21:12:05.623599 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:05.623561 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-69bc7f949b-gksxt_2dbbcfaa-9d5d-4185-b92c-b56ad201875c/metrics-server/0.log" Jul 06 21:12:05.657611 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:05.657580 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-gldhc_e991381e-f373-488a-94a5-0ab6c4426990/monitoring-plugin/0.log" Jul 06 21:12:05.698335 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:05.698289 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-252n9_2da12811-32ad-492c-b6d7-92217ca15164/node-exporter/0.log" Jul 06 21:12:05.719953 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:05.719922 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-252n9_2da12811-32ad-492c-b6d7-92217ca15164/kube-rbac-proxy/0.log" Jul 06 21:12:05.749245 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:05.749223 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-252n9_2da12811-32ad-492c-b6d7-92217ca15164/init-textfile/0.log" Jul 06 21:12:05.947992 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:05.947961 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-q8jq5_f21b17dd-4a00-4514-8ef8-3cb6ee5c3cf0/kube-rbac-proxy-main/0.log" Jul 06 21:12:05.972702 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:05.972667 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-q8jq5_f21b17dd-4a00-4514-8ef8-3cb6ee5c3cf0/kube-rbac-proxy-self/0.log" Jul 06 21:12:05.992888 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:05.992859 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-q8jq5_f21b17dd-4a00-4514-8ef8-3cb6ee5c3cf0/openshift-state-metrics/0.log" Jul 06 21:12:06.031212 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:06.031181 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cd7039df-08e3-4fef-9c16-26dcf1e29992/prometheus/0.log" Jul 06 21:12:06.052877 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:06.052853 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cd7039df-08e3-4fef-9c16-26dcf1e29992/config-reloader/0.log" Jul 06 21:12:06.075510 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:06.075474 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cd7039df-08e3-4fef-9c16-26dcf1e29992/thanos-sidecar/0.log" Jul 06 21:12:06.096995 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:06.096969 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cd7039df-08e3-4fef-9c16-26dcf1e29992/kube-rbac-proxy-web/0.log" Jul 06 21:12:06.121555 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:06.121535 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cd7039df-08e3-4fef-9c16-26dcf1e29992/kube-rbac-proxy/0.log" Jul 06 21:12:06.146625 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:06.146600 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cd7039df-08e3-4fef-9c16-26dcf1e29992/kube-rbac-proxy-thanos/0.log" Jul 06 21:12:06.167293 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:06.167268 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cd7039df-08e3-4fef-9c16-26dcf1e29992/init-config-reloader/0.log" Jul 06 21:12:06.350414 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:06.350331 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-566b589849-2pnvd_5ef5f50a-f6ea-4456-8f52-e88a513d37ef/thanos-query/0.log" Jul 06 21:12:06.372976 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:06.372935 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-566b589849-2pnvd_5ef5f50a-f6ea-4456-8f52-e88a513d37ef/kube-rbac-proxy-web/0.log" Jul 06 21:12:06.396419 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:06.396393 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-566b589849-2pnvd_5ef5f50a-f6ea-4456-8f52-e88a513d37ef/kube-rbac-proxy/0.log" Jul 06 21:12:06.416942 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:06.416916 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-566b589849-2pnvd_5ef5f50a-f6ea-4456-8f52-e88a513d37ef/prom-label-proxy/0.log" Jul 06 21:12:06.438790 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:06.438764 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-566b589849-2pnvd_5ef5f50a-f6ea-4456-8f52-e88a513d37ef/kube-rbac-proxy-rules/0.log" Jul 06 21:12:06.462048 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:06.462022 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-566b589849-2pnvd_5ef5f50a-f6ea-4456-8f52-e88a513d37ef/kube-rbac-proxy-metrics/0.log" Jul 06 21:12:07.667275 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:07.667244 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-f29qt_1867e5c6-1cdc-4302-b705-5c7cd807677b/networking-console-plugin/0.log" Jul 06 21:12:08.978654 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:08.978619 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-kmj89_1f61871c-5112-4899-b3f7-4c88752b416f/volume-data-source-validator/0.log" Jul 06 21:12:09.268373 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:09.268287 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jwtdb/perf-node-gather-daemonset-88x5v"] Jul 06 21:12:09.268652 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:09.268636 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21e6ad8b-efe9-4faf-a400-e1014c3dfbb5" containerName="registry" Jul 06 21:12:09.268698 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:09.268651 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="21e6ad8b-efe9-4faf-a400-e1014c3dfbb5" containerName="registry" Jul 06 21:12:09.268698 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:09.268675 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56589b7e-e251-4b7a-a8e7-48c90ab765ed" containerName="console" Jul 06 21:12:09.268698 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:09.268681 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="56589b7e-e251-4b7a-a8e7-48c90ab765ed" containerName="console" Jul 06 21:12:09.268803 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:09.268748 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="21e6ad8b-efe9-4faf-a400-e1014c3dfbb5" containerName="registry" Jul 06 21:12:09.268803 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:09.268762 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="56589b7e-e251-4b7a-a8e7-48c90ab765ed" containerName="console" Jul 06 21:12:09.271759 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:09.271738 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jwtdb/perf-node-gather-daemonset-88x5v" Jul 06 21:12:09.273901 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:09.273876 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jwtdb\"/\"kube-root-ca.crt\"" Jul 06 21:12:09.274987 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:09.274967 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jwtdb\"/\"default-dockercfg-wvp48\"" Jul 06 21:12:09.274987 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:09.274981 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jwtdb\"/\"openshift-service-ca.crt\"" Jul 06 21:12:09.279158 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:09.279041 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jwtdb/perf-node-gather-daemonset-88x5v"] Jul 06 21:12:09.352871 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:09.352840 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0f3e8e7a-f0fd-48ca-868b-3234aa462008-podres\") pod \"perf-node-gather-daemonset-88x5v\" (UID: \"0f3e8e7a-f0fd-48ca-868b-3234aa462008\") " pod="openshift-must-gather-jwtdb/perf-node-gather-daemonset-88x5v" Jul 06 21:12:09.353069 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:09.352886 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hp8s4\" (UniqueName: \"kubernetes.io/projected/0f3e8e7a-f0fd-48ca-868b-3234aa462008-kube-api-access-hp8s4\") pod \"perf-node-gather-daemonset-88x5v\" (UID: \"0f3e8e7a-f0fd-48ca-868b-3234aa462008\") " pod="openshift-must-gather-jwtdb/perf-node-gather-daemonset-88x5v" Jul 06 21:12:09.353069 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:09.352910 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0f3e8e7a-f0fd-48ca-868b-3234aa462008-sys\") pod \"perf-node-gather-daemonset-88x5v\" (UID: \"0f3e8e7a-f0fd-48ca-868b-3234aa462008\") " pod="openshift-must-gather-jwtdb/perf-node-gather-daemonset-88x5v" Jul 06 21:12:09.353069 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:09.352977 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0f3e8e7a-f0fd-48ca-868b-3234aa462008-proc\") pod \"perf-node-gather-daemonset-88x5v\" (UID: \"0f3e8e7a-f0fd-48ca-868b-3234aa462008\") " pod="openshift-must-gather-jwtdb/perf-node-gather-daemonset-88x5v" Jul 06 21:12:09.353069 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:09.353031 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0f3e8e7a-f0fd-48ca-868b-3234aa462008-lib-modules\") pod \"perf-node-gather-daemonset-88x5v\" (UID: \"0f3e8e7a-f0fd-48ca-868b-3234aa462008\") " pod="openshift-must-gather-jwtdb/perf-node-gather-daemonset-88x5v" Jul 06 21:12:09.453613 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:09.453579 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0f3e8e7a-f0fd-48ca-868b-3234aa462008-podres\") pod \"perf-node-gather-daemonset-88x5v\" (UID: \"0f3e8e7a-f0fd-48ca-868b-3234aa462008\") " pod="openshift-must-gather-jwtdb/perf-node-gather-daemonset-88x5v" Jul 06 21:12:09.453776 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:09.453634 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hp8s4\" (UniqueName: \"kubernetes.io/projected/0f3e8e7a-f0fd-48ca-868b-3234aa462008-kube-api-access-hp8s4\") pod \"perf-node-gather-daemonset-88x5v\" (UID: \"0f3e8e7a-f0fd-48ca-868b-3234aa462008\") " pod="openshift-must-gather-jwtdb/perf-node-gather-daemonset-88x5v" Jul 06 21:12:09.453776 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:09.453658 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0f3e8e7a-f0fd-48ca-868b-3234aa462008-sys\") pod \"perf-node-gather-daemonset-88x5v\" (UID: \"0f3e8e7a-f0fd-48ca-868b-3234aa462008\") " pod="openshift-must-gather-jwtdb/perf-node-gather-daemonset-88x5v" Jul 06 21:12:09.453776 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:09.453688 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0f3e8e7a-f0fd-48ca-868b-3234aa462008-proc\") pod \"perf-node-gather-daemonset-88x5v\" (UID: \"0f3e8e7a-f0fd-48ca-868b-3234aa462008\") " pod="openshift-must-gather-jwtdb/perf-node-gather-daemonset-88x5v" Jul 06 21:12:09.453776 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:09.453717 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0f3e8e7a-f0fd-48ca-868b-3234aa462008-lib-modules\") pod \"perf-node-gather-daemonset-88x5v\" (UID: \"0f3e8e7a-f0fd-48ca-868b-3234aa462008\") " pod="openshift-must-gather-jwtdb/perf-node-gather-daemonset-88x5v" Jul 06 21:12:09.453776 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:09.453756 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0f3e8e7a-f0fd-48ca-868b-3234aa462008-podres\") pod \"perf-node-gather-daemonset-88x5v\" (UID: \"0f3e8e7a-f0fd-48ca-868b-3234aa462008\") " pod="openshift-must-gather-jwtdb/perf-node-gather-daemonset-88x5v" Jul 06 21:12:09.454074 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:09.453796 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0f3e8e7a-f0fd-48ca-868b-3234aa462008-sys\") pod \"perf-node-gather-daemonset-88x5v\" (UID: \"0f3e8e7a-f0fd-48ca-868b-3234aa462008\") " pod="openshift-must-gather-jwtdb/perf-node-gather-daemonset-88x5v" Jul 06 21:12:09.454074 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:09.453799 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0f3e8e7a-f0fd-48ca-868b-3234aa462008-proc\") pod \"perf-node-gather-daemonset-88x5v\" (UID: \"0f3e8e7a-f0fd-48ca-868b-3234aa462008\") " pod="openshift-must-gather-jwtdb/perf-node-gather-daemonset-88x5v" Jul 06 21:12:09.454074 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:09.453845 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0f3e8e7a-f0fd-48ca-868b-3234aa462008-lib-modules\") pod \"perf-node-gather-daemonset-88x5v\" (UID: \"0f3e8e7a-f0fd-48ca-868b-3234aa462008\") " pod="openshift-must-gather-jwtdb/perf-node-gather-daemonset-88x5v" Jul 06 21:12:09.461174 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:09.461148 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hp8s4\" (UniqueName: \"kubernetes.io/projected/0f3e8e7a-f0fd-48ca-868b-3234aa462008-kube-api-access-hp8s4\") pod \"perf-node-gather-daemonset-88x5v\" (UID: \"0f3e8e7a-f0fd-48ca-868b-3234aa462008\") " pod="openshift-must-gather-jwtdb/perf-node-gather-daemonset-88x5v" Jul 06 21:12:09.582533 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:09.582439 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jwtdb/perf-node-gather-daemonset-88x5v" Jul 06 21:12:09.708182 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:09.708158 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jwtdb/perf-node-gather-daemonset-88x5v"] Jul 06 21:12:09.710306 ip-10-0-131-182 kubenswrapper[2563]: W0706 21:12:09.710278 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0f3e8e7a_f0fd_48ca_868b_3234aa462008.slice/crio-4ba1443229764e47f40a879080e4fcd571331f831184c73962e3f5d0d4492a04 WatchSource:0}: Error finding container 4ba1443229764e47f40a879080e4fcd571331f831184c73962e3f5d0d4492a04: Status 404 returned error can't find the container with id 4ba1443229764e47f40a879080e4fcd571331f831184c73962e3f5d0d4492a04 Jul 06 21:12:09.792534 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:09.792497 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jwtdb/perf-node-gather-daemonset-88x5v" event={"ID":"0f3e8e7a-f0fd-48ca-868b-3234aa462008","Type":"ContainerStarted","Data":"4ba1443229764e47f40a879080e4fcd571331f831184c73962e3f5d0d4492a04"} Jul 06 21:12:09.866289 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:09.866268 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pftrl_05fbf402-3b73-4ed1-a153-4e3367a41518/dns/0.log" Jul 06 21:12:09.888337 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:09.888296 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pftrl_05fbf402-3b73-4ed1-a153-4e3367a41518/kube-rbac-proxy/0.log" Jul 06 21:12:09.956124 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:09.956095 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zhhvw_34abb9cb-886c-4133-b204-c5c02d6dbdf6/dns-node-resolver/0.log" Jul 06 21:12:10.335634 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:10.335605 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-28sv5_a7028afb-6989-4fe8-a9a6-1230b13b505e/node-ca/0.log" Jul 06 21:12:10.797766 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:10.797728 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jwtdb/perf-node-gather-daemonset-88x5v" event={"ID":"0f3e8e7a-f0fd-48ca-868b-3234aa462008","Type":"ContainerStarted","Data":"f696227368281cae1ddfd4eaf19a3474553225cebba165083ab7df58003f87f4"} Jul 06 21:12:10.797932 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:10.797811 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jwtdb/perf-node-gather-daemonset-88x5v" Jul 06 21:12:10.812426 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:10.812382 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jwtdb/perf-node-gather-daemonset-88x5v" podStartSLOduration=1.81236783 podStartE2EDuration="1.81236783s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:12:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:12:10.811990156 +0000 UTC m=+477.330228308" watchObservedRunningTime="2026-07-06 21:12:10.81236783 +0000 UTC m=+477.330605962" Jul 06 21:12:11.355832 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:11.355799 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-k5tm2_22c46544-3b08-4ad7-8f17-8a1210bf99b4/serve-healthcheck-canary/0.log" Jul 06 21:12:11.712574 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:11.712547 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-vsz75_e6c752c6-9cfb-4761-b7ce-ca3e2d37e6a2/insights-operator/1.log" Jul 06 21:12:11.714134 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:11.714105 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-vsz75_e6c752c6-9cfb-4761-b7ce-ca3e2d37e6a2/insights-operator/0.log" Jul 06 21:12:11.874261 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:11.874233 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x54fd_0c22c270-f12e-4853-99a7-1e2d46504221/kube-rbac-proxy/0.log" Jul 06 21:12:11.892900 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:11.892874 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x54fd_0c22c270-f12e-4853-99a7-1e2d46504221/exporter/0.log" Jul 06 21:12:11.918705 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:11.918666 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x54fd_0c22c270-f12e-4853-99a7-1e2d46504221/extractor/0.log" Jul 06 21:12:15.686795 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:15.686768 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-zqbsb_8ef7addd-b3d3-4a55-861e-f16bf7a3fb8a/migrator/0.log" Jul 06 21:12:15.705124 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:15.705099 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-zqbsb_8ef7addd-b3d3-4a55-861e-f16bf7a3fb8a/graceful-termination/0.log" Jul 06 21:12:15.965143 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:15.965065 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-vcp8r_826404fc-09bb-44da-bd6a-3d071e3009c8/kube-storage-version-migrator-operator/1.log" Jul 06 21:12:15.966627 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:15.966604 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-vcp8r_826404fc-09bb-44da-bd6a-3d071e3009c8/kube-storage-version-migrator-operator/0.log" Jul 06 21:12:16.697829 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:16.697799 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-24957_f38e9c39-8bb8-44e7-b69c-1da913bec44a/kube-multus/0.log" Jul 06 21:12:16.813048 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:16.813022 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jwtdb/perf-node-gather-daemonset-88x5v" Jul 06 21:12:16.900108 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:16.900082 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p2h5x_2d9510b7-6982-4ead-a75a-e5816ef5b9ab/kube-multus-additional-cni-plugins/0.log" Jul 06 21:12:16.921693 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:16.921670 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p2h5x_2d9510b7-6982-4ead-a75a-e5816ef5b9ab/egress-router-binary-copy/0.log" Jul 06 21:12:16.943104 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:16.943082 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p2h5x_2d9510b7-6982-4ead-a75a-e5816ef5b9ab/cni-plugins/0.log" Jul 06 21:12:16.965331 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:16.965255 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p2h5x_2d9510b7-6982-4ead-a75a-e5816ef5b9ab/bond-cni-plugin/0.log" Jul 06 21:12:16.988271 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:16.988241 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p2h5x_2d9510b7-6982-4ead-a75a-e5816ef5b9ab/routeoverride-cni/0.log" Jul 06 21:12:17.009824 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:17.009806 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p2h5x_2d9510b7-6982-4ead-a75a-e5816ef5b9ab/whereabouts-cni-bincopy/0.log" Jul 06 21:12:17.031922 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:17.031892 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p2h5x_2d9510b7-6982-4ead-a75a-e5816ef5b9ab/whereabouts-cni/0.log" Jul 06 21:12:17.335747 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:17.335664 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-c795j_084dc07e-e49b-44e3-95cc-11e11c5037a5/network-metrics-daemon/0.log" Jul 06 21:12:17.357490 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:17.357458 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-c795j_084dc07e-e49b-44e3-95cc-11e11c5037a5/kube-rbac-proxy/0.log" Jul 06 21:12:18.385259 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:18.385229 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nsmng_67ff5eff-b2cf-45c9-ab38-9650657413b9/ovn-controller/0.log" Jul 06 21:12:18.403337 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:18.403284 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nsmng_67ff5eff-b2cf-45c9-ab38-9650657413b9/ovn-acl-logging/1.log" Jul 06 21:12:18.403513 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:18.403347 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nsmng_67ff5eff-b2cf-45c9-ab38-9650657413b9/ovn-acl-logging/0.log" Jul 06 21:12:18.431187 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:18.431159 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nsmng_67ff5eff-b2cf-45c9-ab38-9650657413b9/kube-rbac-proxy-node/0.log" Jul 06 21:12:18.456168 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:18.456125 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nsmng_67ff5eff-b2cf-45c9-ab38-9650657413b9/kube-rbac-proxy-ovn-metrics/0.log" Jul 06 21:12:18.481632 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:18.481608 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nsmng_67ff5eff-b2cf-45c9-ab38-9650657413b9/northd/0.log" Jul 06 21:12:18.509071 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:18.508992 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nsmng_67ff5eff-b2cf-45c9-ab38-9650657413b9/nbdb/0.log" Jul 06 21:12:18.542694 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:18.542667 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nsmng_67ff5eff-b2cf-45c9-ab38-9650657413b9/sbdb/0.log" Jul 06 21:12:18.596894 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:18.596862 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nsmng_67ff5eff-b2cf-45c9-ab38-9650657413b9/ovnkube-controller/0.log" Jul 06 21:12:19.772476 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:19.772448 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-lvgtq_f107cce5-b80b-4c37-9d88-e582acb83168/network-check-target-container/0.log" Jul 06 21:12:20.641990 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:20.641886 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-hnqfz_6795ede2-22ae-4bd6-932a-f1b7ff2a54ed/iptables-alerter/0.log" Jul 06 21:12:21.268397 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:21.268345 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-lvxjl_1cfb7af5-011a-4522-96bf-00eaf75fe18e/tuned/0.log" Jul 06 21:12:23.781761 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:23.781685 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-5d46d9ffd4-z727m_d8331c1e-5061-4874-9338-e9daf1c79b83/service-ca-operator/1.log" Jul 06 21:12:23.783062 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:23.783037 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-5d46d9ffd4-z727m_d8331c1e-5061-4874-9338-e9daf1c79b83/service-ca-operator/0.log" Jul 06 21:12:24.112449 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:24.112360 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca_service-ca-758f599c5-nctmn_7292a65b-f336-4541-a96e-cadfb1a0cd6c/service-ca-controller/0.log" Jul 06 21:12:24.510737 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:24.510707 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-8xz26_d1f73fe4-61a3-46b0-9221-4c49b9a74186/csi-driver/0.log" Jul 06 21:12:24.529898 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:24.529863 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-8xz26_d1f73fe4-61a3-46b0-9221-4c49b9a74186/csi-node-driver-registrar/0.log" Jul 06 21:12:24.550523 ip-10-0-131-182 kubenswrapper[2563]: I0706 21:12:24.550490 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-8xz26_d1f73fe4-61a3-46b0-9221-4c49b9a74186/csi-liveness-probe/0.log"